-- Logs begin at Fri 2022-10-28 08:59:46 UTC, end at Fri 2022-10-28 10:09:17 UTC. -- Oct 28 09:36:33.400321 dv-cinder-zed-3-smb systemd[1]: Starting Devstack devstack@n-api.service... Oct 28 09:36:33.412540 dv-cinder-zed-3-smb devstack@n-api.service[112025]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 28 09:36:33.415614 dv-cinder-zed-3-smb devstack@n-api.service[112025]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Oct 28 09:36:33 2022] *** Oct 28 09:36:33.415614 dv-cinder-zed-3-smb devstack@n-api.service[112025]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 28 09:36:33.415614 dv-cinder-zed-3-smb devstack@n-api.service[112025]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 28 09:36:33.415614 dv-cinder-zed-3-smb devstack@n-api.service[112025]: nodename: dv-cinder-zed-3-smb Oct 28 09:36:33.415614 dv-cinder-zed-3-smb devstack@n-api.service[112025]: machine: x86_64 Oct 28 09:36:33.415614 dv-cinder-zed-3-smb devstack@n-api.service[112025]: clock source: unix Oct 28 09:36:33.415614 dv-cinder-zed-3-smb devstack@n-api.service[112025]: pcre jit disabled Oct 28 09:36:33.415614 dv-cinder-zed-3-smb devstack@n-api.service[112025]: detected number of CPU cores: 4 Oct 28 09:36:33.415614 dv-cinder-zed-3-smb devstack@n-api.service[112025]: current working directory: / Oct 28 09:36:33.415614 dv-cinder-zed-3-smb devstack@n-api.service[112025]: detected binary path: /usr/bin/uwsgi-core Oct 28 09:36:33.415614 dv-cinder-zed-3-smb devstack@n-api.service[112025]: your processes number limit is 47680 Oct 28 09:36:33.415614 dv-cinder-zed-3-smb devstack@n-api.service[112025]: your memory page size is 4096 bytes Oct 28 09:36:33.416516 dv-cinder-zed-3-smb devstack@n-api.service[112025]: detected max file descriptor number: 2048 Oct 28 09:36:33.416516 dv-cinder-zed-3-smb devstack@n-api.service[112025]: lock engine: pthread robust mutexes Oct 28 09:36:33.416516 dv-cinder-zed-3-smb devstack@n-api.service[112025]: thunder lock: enabled Oct 28 09:36:33.416516 dv-cinder-zed-3-smb devstack@n-api.service[112025]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 28 09:36:33.416516 dv-cinder-zed-3-smb devstack@n-api.service[112025]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 28 09:36:33.456703 dv-cinder-zed-3-smb devstack@n-api.service[112025]: Python main interpreter initialized at 0x561da54329c0 Oct 28 09:36:33.456703 dv-cinder-zed-3-smb devstack@n-api.service[112025]: python threads support enabled Oct 28 09:36:33.456703 dv-cinder-zed-3-smb devstack@n-api.service[112025]: your server socket listen backlog is limited to 100 connections Oct 28 09:36:33.456703 dv-cinder-zed-3-smb devstack@n-api.service[112025]: your mercy for graceful operations on workers is 90 seconds Oct 28 09:36:33.457265 dv-cinder-zed-3-smb devstack@n-api.service[112025]: mapped 403077 bytes (393 KB) for 2 cores Oct 28 09:36:33.457265 dv-cinder-zed-3-smb devstack@n-api.service[112025]: *** Operational MODE: preforking *** Oct 28 09:36:33.457492 dv-cinder-zed-3-smb devstack@n-api.service[112025]: *** uWSGI is running in multiple interpreter mode *** Oct 28 09:36:33.457492 dv-cinder-zed-3-smb devstack@n-api.service[112025]: spawned uWSGI master process (pid: 112025) Oct 28 09:36:33.457638 dv-cinder-zed-3-smb systemd[1]: Started Devstack devstack@n-api.service. Oct 28 09:36:33.459456 dv-cinder-zed-3-smb devstack@n-api.service[112025]: spawned uWSGI worker 1 (pid: 112028, cores: 1) Oct 28 09:36:33.459456 dv-cinder-zed-3-smb devstack@n-api.service[112025]: spawned uWSGI worker 2 (pid: 112029, cores: 1) Oct 28 09:36:33.461106 dv-cinder-zed-3-smb devstack@n-api.service[112025]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 28 09:36:34.174542 dv-cinder-zed-3-smb devstack@n-api.service[112028]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 28 09:36:34.182250 dv-cinder-zed-3-smb devstack@n-api.service[112029]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 28 09:36:35.270308 dv-cinder-zed-3-smb devstack@n-api.service[112028]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 28 09:36:35.270308 dv-cinder-zed-3-smb devstack@n-api.service[112028]: from cryptography.utils import int_from_bytes Oct 28 09:36:35.270983 dv-cinder-zed-3-smb devstack@n-api.service[112028]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 28 09:36:35.270983 dv-cinder-zed-3-smb devstack@n-api.service[112028]: from cryptography.utils import int_from_bytes Oct 28 09:36:35.377718 dv-cinder-zed-3-smb devstack@n-api.service[112029]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 28 09:36:35.377718 dv-cinder-zed-3-smb devstack@n-api.service[112029]: from cryptography.utils import int_from_bytes Oct 28 09:36:35.378604 dv-cinder-zed-3-smb devstack@n-api.service[112029]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 28 09:36:35.378604 dv-cinder-zed-3-smb devstack@n-api.service[112029]: from cryptography.utils import int_from_bytes Oct 28 09:36:37.785617 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 28 09:36:37.786269 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 28 09:36:37.786388 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 28 09:36:37.786751 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 28 09:36:37.787004 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 28 09:36:37.787974 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.788307 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.788625 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.788939 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.789267 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.789572 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.789891 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.790207 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.790528 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.790787 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.791098 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.791419 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-zed-3-smb {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.791738 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.792089 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.792373 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.792687 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.792987 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.793304 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.793672 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.794113 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.795641 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.795641 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.795641 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.795641 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.796434 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.796434 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.796434 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.797052 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.797052 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.797369 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.797677 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-zed-3-smb {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.797997 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.798294 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.798610 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.799022 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.799335 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.799644 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.799990 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.800313 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.800621 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.800942 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.801248 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.801564 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.801888 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.802188 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.802525 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.802802 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.803151 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.803454 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.803779 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.804030 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.804346 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.804665 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.804985 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.805296 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.805549 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.805800 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.806121 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.806442 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.806746 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.807046 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.807354 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.807662 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.807998 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.808304 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.808621 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.808914 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.809231 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.809549 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.809872 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.810180 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.810501 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.810904 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.52 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.811151 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.52 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.811457 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.811827 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.812153 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.812463 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.812781 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.813105 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.813415 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.813718 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.814031 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.814351 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.814680 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.814987 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.815236 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.815539 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.815863 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.816185 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.816492 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.816849 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.817141 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.817404 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.817404 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.818180 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.818315 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.818621 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.818930 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.819233 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.819612 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.819863 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.820165 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.820469 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.820785 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.821102 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.821409 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.821710 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.822014 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.822320 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.822634 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.822938 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.823241 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.823562 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.823900 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.824206 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.824524 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.824828 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.825135 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.825453 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.825750 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.826055 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.826370 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.826676 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.826978 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.827280 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.827583 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.827910 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.828216 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.828517 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.828818 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.829118 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.829434 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.829756 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.830063 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.830367 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.830674 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.830995 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.831330 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.831663 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.832032 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.832346 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.832685 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.833011 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.833331 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.833707 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.833960 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.834821 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.835132 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.835444 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.835787 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.836098 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.836414 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.836746 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.837063 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.837396 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.837701 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.838008 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.838329 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.838657 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.838982 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.839291 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.839629 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.840256 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.840566 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.840892 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.841218 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.841527 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.841838 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.842149 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.842492 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.842801 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.843113 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.843429 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.843787 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.844083 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.844401 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.844711 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.845022 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.845330 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.845639 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.845976 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.846290 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.846613 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.846925 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.847237 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.847553 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.847892 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.848202 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.848515 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.848818 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.849120 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.849425 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.849732 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.850675 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.850998 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.851336 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.851640 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.851995 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.852306 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.852615 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.852926 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.853238 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.853541 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.853856 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.854171 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.854478 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.854805 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.855122 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.855425 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.855777 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.856078 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.856386 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.856701 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.857014 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.857326 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.857637 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.857948 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.858271 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.858583 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.858896 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.859228 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.859562 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.859900 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.860226 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.860549 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.860867 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.861167 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.861481 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.861779 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.862083 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.862382 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.862691 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.862989 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.863289 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.863590 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.863916 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.864221 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.864550 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.864857 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.865165 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.865512 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.865816 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.866161 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.866465 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.866805 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.867141 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.867463 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.867805 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.868121 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.868437 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.868751 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.869061 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.869370 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.869686 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.869998 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.870310 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.870633 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.870940 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.871258 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.871569 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.871918 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.872219 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.872535 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.872874 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.873209 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.873524 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.873845 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.874156 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.874474 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.874785 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.875097 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.875407 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.875715 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.876060 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.876374 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.876692 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.876998 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.877320 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.877737 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.877949 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.878254 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.878561 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.878893 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.879223 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.879533 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.879872 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.880191 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.880500 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.880807 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.881150 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.881453 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.881762 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.882064 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.882377 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.882687 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.882997 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.883296 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.883611 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.883946 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.884249 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.884557 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.884867 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.885189 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.885502 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.885819 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.886140 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.886437 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.886790 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.887056 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.887364 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.887669 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.888005 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.888307 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.888651 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.888958 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.889260 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.889576 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.889901 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.890207 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.890524 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.890834 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.891143 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.891458 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.891786 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.892102 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.892407 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.894848 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.894848 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.894848 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.894848 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.894848 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.894848 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.894848 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.894848 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.895830 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.895830 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.896061 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.896315 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.897156 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.897491 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.897839 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.898161 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.898497 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.898829 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.899161 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.899452 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.899782 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.900091 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.900396 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.900708 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.901014 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.901319 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.901622 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.901932 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.902234 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.902536 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.902839 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.903141 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.903458 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.903785 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.904097 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.904402 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.904727 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.905043 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.905349 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.905652 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.905957 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.906298 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.906602 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.906940 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.907270 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.907613 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.907945 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.908252 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.908579 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.908885 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.909188 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.909492 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.909802 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.910110 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.910412 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.910724 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.911039 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.911345 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.911652 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.911988 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.912375 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.913153 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.913466 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.913776 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.914080 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.914382 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.914744 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.915010 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.915313 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.915622 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.915961 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.916268 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.916572 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.916874 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.917177 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.917485 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.917790 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.918092 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.918421 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.918731 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.919036 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.919339 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.919643 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.919971 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.920277 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.920580 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.920907 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.921217 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.921517 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.921825 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.922129 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.922430 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.922737 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.923041 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.923344 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.923641 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.923964 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.924269 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.924569 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.924897 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.925204 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.925510 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.925818 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.926118 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.926464 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.926763 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.927127 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.927427 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.927761 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.928145 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.928475 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.928790 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.929105 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.929405 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.929735 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.930025 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.930342 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.930639 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.930945 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.931261 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.931572 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.931910 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.932232 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.932548 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.932871 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.933172 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.933484 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.933787 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.934100 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.934406 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.934791 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.935027 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.935333 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.935726 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.935981 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.936293 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.936596 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.936908 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.937208 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.937511 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.937835 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.938137 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.938436 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.938743 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.939048 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.939360 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.939660 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.940127 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.940440 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.940745 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.941052 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.941363 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.941668 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.941982 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.942299 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.942600 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.943027 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.943336 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.943673 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.944004 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.944307 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.944608 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.944926 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.945252 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.945556 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.945855 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.946216 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.946475 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.946772 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.947095 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.947514 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.947852 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.948157 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.948573 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.948888 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.949269 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.949514 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.949834 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.950157 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.950460 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.950776 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.951084 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.951405 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.951726 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.952071 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.952385 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.953276 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.953276 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.953620 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.953620 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.953969 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.954343 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.954663 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.954974 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.955296 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.955626 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.955954 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.956255 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.956565 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.956869 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.957175 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.957491 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.957797 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.958102 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.958406 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.958706 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.959005 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.959873 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.960195 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.960492 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.960816 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.961127 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.961452 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.961770 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.962075 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.962399 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.962707 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.963010 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.963325 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.963614 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.963998 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.964296 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.964613 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.965196 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.965530 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.965841 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.966090 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 28 09:36:37.966736 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.966855 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 28 09:36:37.967031 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.967031 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.967338 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 28 09:36:37.967540 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.967540 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.967967 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 28 09:36:37.967967 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 28 09:36:37.968349 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.968349 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.968709 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.968901 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.969096 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.969291 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.969291 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.969653 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.969856 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.970058 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.970256 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.970447 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.970651 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.970651 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.971037 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.971243 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.971427 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.971629 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.971804 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.971945 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.972085 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.972223 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.972348 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.972486 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.972486 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.972819 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.972981 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.973156 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-zed-3-smb {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.973343 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.973546 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.973753 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.973945 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.974138 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.974138 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.974515 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.974706 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.975511 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.975695 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.975895 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.976089 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.976297 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.976491 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.976698 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.976891 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.976891 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.977192 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.977404 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.977595 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.977791 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.977791 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.978152 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.978346 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.978538 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.978744 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.978939 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.979131 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.979320 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.979511 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.979511 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.979927 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.979927 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.980305 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.980498 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.980693 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.980901 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.981095 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.981095 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.981460 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.981654 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.981871 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-zed-3-smb {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.982076 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.982281 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.982477 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.982477 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.982853 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.983032 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.983217 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.983389 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.983557 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.983731 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.983967 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.984155 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.984155 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.984493 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.984670 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.984852 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.985017 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.985179 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.985338 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.985503 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.985675 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.985841 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.986006 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.986006 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.986325 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.986325 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.986637 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.986637 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.986964 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.987110 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.987275 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.987438 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.987613 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.987809 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.987970 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.988130 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.988303 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.988462 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.988632 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.988793 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.988952 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.988952 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.989268 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.989472 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.989678 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.989867 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.990054 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.990054 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.990419 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.990622 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.990814 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.990814 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.991190 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.991385 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.991581 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.991867 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.992065 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.992261 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.992475 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.992671 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.992877 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.993073 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.993269 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.993463 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.993673 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.993868 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.994078 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.994275 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.994472 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.994667 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.994861 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.995055 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.995263 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.995473 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.995663 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.995876 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.996061 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.996366 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.996564 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.996564 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.996981 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.997178 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.997377 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.997586 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.997782 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.997975 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.997975 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.998348 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.52 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.998545 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.998751 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.52 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.998953 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.999146 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.999357 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:37.999615 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:37.999900 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.000114 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:38.000310 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.000504 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:38.000691 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.000886 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:38.001092 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.001301 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:38.001500 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.001700 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:38.001885 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.002081 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:38.002300 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.002300 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.002680 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:38.002857 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.003020 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:38.003195 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.003377 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:38.003572 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.003780 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:38.003970 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.004156 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:38.004363 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.004363 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.004708 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:38.004957 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.005126 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:38.005280 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.005492 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:38.005634 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.005831 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:38.005962 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.006126 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:38.006331 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.006485 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:38.006653 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.006653 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.007019 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:38.007198 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.007375 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:38.007592 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.007821 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:38.008020 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.008185 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:38.008380 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.008574 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:38.008731 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.008880 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:38.009074 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.009206 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:38.009395 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.009395 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.009704 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:38.009842 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.009978 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:38.010130 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.010311 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:38.010497 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.010684 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:38.010884 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.010884 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.011246 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:38.011438 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.011652 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:38.011869 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.012056 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:38.012270 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.012461 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:38.012664 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.012867 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:38.013054 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.013247 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:38.013438 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.013625 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:38.013824 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.013824 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.014220 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:38.014407 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.014611 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:38.014806 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.015005 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:38.015215 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.015414 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:38.015613 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.015857 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:38.016054 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.016249 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:38.016467 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.016661 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:38.016855 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.017066 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:38.017066 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:38.017451 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.017646 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:38.017839 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.018025 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:38.018220 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.018403 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:38.018599 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.018791 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:38.018984 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.019172 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:38.019359 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.019546 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:38.019786 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.019978 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:38.020162 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.020357 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:38.020553 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.020748 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:38.020962 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.021167 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:38.021371 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.021575 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:38.022262 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.022457 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:38.022646 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.022841 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:38.023027 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.023218 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:38.023425 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.023613 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:38.023816 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.023945 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:38.024115 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.024311 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:38.024503 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.024503 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.024809 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:36:38.024978 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.025154 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.025301 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.025453 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.025590 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.025823 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.026022 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.026219 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.026412 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.026624 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.026803 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.026990 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.027184 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.027379 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.027579 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.027771 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.027930 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.028076 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.028268 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.028415 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.028557 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.028697 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.028847 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.029028 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.029204 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.029359 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.029569 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.029769 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.029937 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.030101 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.030306 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.030461 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.030717 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.030853 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.031001 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.031194 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.031194 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.031556 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.031782 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.031974 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.032168 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.032362 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.032555 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.032774 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.032968 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.033159 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.033343 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.033547 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.033737 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.033948 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.034139 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.034329 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.034519 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.034712 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.034902 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.035112 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.035311 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.035497 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.035838 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.036163 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.036335 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.036528 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.036677 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.036872 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.037004 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.037156 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.037156 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.038047 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.038234 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.038428 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.038630 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.038820 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.039024 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.039220 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.039416 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.039611 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.039847 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.040066 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.040273 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.040466 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.040657 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.040861 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.041054 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.041257 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.041446 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.041654 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.041849 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.042057 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.042249 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.042453 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.042659 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.042659 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.043020 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.043222 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.043425 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.043680 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.043947 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.044158 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.044351 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.044544 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.044740 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.044947 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.045137 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.045327 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.045520 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.045715 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.045921 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.046126 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.046329 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.046521 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.046706 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.046899 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.047104 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.047302 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.047302 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.047656 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.047869 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.048081 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.048296 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.048490 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.048696 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.048894 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.049091 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.049282 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.049488 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.049696 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.049896 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.050089 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.050281 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.050485 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.050675 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.050864 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.051054 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.051255 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.051444 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.051645 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.051938 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.051938 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.052303 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.052502 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.052685 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.052917 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.053115 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.053304 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.053502 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.053694 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.053901 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.054108 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.054315 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.054519 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.054711 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.054913 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.055118 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.055359 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.055574 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.055804 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.055996 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.056207 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.056360 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.056519 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.056727 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.056876 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.057026 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.057184 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.057357 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.057549 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.057746 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.057875 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.058033 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.058222 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.058222 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.058538 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.058716 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.058885 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.059068 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.059258 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.059427 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.059611 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.059810 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.059999 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.060171 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.060351 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.060528 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.060707 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.060879 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.061045 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.061212 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.061382 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.061564 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.061772 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.061963 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.062156 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.062348 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.062537 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.062723 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.062919 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.062919 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.063279 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.063475 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.063693 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.064024 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.064216 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.064424 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.064657 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.064845 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.065043 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.065242 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.065440 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.065626 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.065828 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.065828 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 28 09:36:38.066201 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.066201 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.066201 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.066201 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.066201 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.066201 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.066201 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.066201 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.067423 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.067423 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.067423 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.067423 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.067423 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.067423 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.067423 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.067423 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.068446 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.068446 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.068446 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.068446 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.068446 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.068446 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.068446 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.068446 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.069938 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.069938 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.069938 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.069938 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.069938 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.069938 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.069938 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.069938 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.070907 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.070907 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.070907 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.070907 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.070907 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.070907 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.070907 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.070907 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.071915 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.071915 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.071915 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.071915 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.071915 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.071915 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.071915 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.071915 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.072904 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.072904 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.072904 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.072904 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.072904 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.072904 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.072904 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.072904 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.073882 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.073882 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.073882 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.073882 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.073882 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.073882 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.073882 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.073882 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.074843 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.074843 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.074843 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.074843 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.074843 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.074843 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.074843 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.074843 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.075866 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.075866 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.075866 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.075866 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.075866 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.075866 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.075866 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.075866 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.076989 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.076989 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.076989 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.076989 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.076989 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.077591 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.077591 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.078012 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.078328 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.078796 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.079122 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.079440 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.079852 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.080168 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.080487 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.080948 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.081558 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.081898 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.082220 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.082626 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.083107 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.083499 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.083881 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.084779 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.085118 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.085431 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.085747 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.086058 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.086367 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.086685 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.086991 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.087297 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.087610 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.087954 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.088265 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.088575 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.088883 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.089195 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.089523 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.090081 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.090413 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.090721 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.091060 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.091376 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.091688 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.092028 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.092339 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.092693 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.093000 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.093349 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.093683 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.094033 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.094420 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.094735 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.095070 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.095374 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.095680 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.096016 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.096334 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.096644 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.096952 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.097269 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.097583 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.097901 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.098213 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.098519 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.098836 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.099149 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.099468 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.099910 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.100207 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.100526 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.100842 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.101155 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.101467 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.101786 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.102096 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.102463 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.102744 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.103128 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.103368 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.103664 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.103973 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.104283 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.104624 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.104941 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.105253 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.105641 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.106083 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.106399 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.106709 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.107027 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.107357 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.107680 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.108020 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.108336 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.108645 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.108966 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.109277 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.109585 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.109980 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.110308 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.110596 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.110901 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.111213 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.111547 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.111884 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.112199 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.112573 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.112893 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.113249 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.113554 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.113921 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.114226 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.114546 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.114878 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.115255 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.115618 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.116040 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.116349 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.116669 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.116989 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.117303 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.117609 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.117914 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.118249 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.118562 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.118883 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.119239 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.119568 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.119928 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.120235 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.120544 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.120936 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.121246 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.121567 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.121875 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.122197 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.122518 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.122891 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.123149 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.123462 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.123787 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.124104 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.124424 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.124733 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.125063 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.125376 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.125690 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.126001 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.126309 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.126624 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.126933 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.127378 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.127696 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.128575 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.128575 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.128980 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.128980 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.129422 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.129646 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.129869 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.130288 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.130600 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.130922 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.131880 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.132192 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.132500 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.132822 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.133149 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.133462 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.133768 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.134077 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.134402 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.134709 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.135034 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.135474 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.135815 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.136201 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.136546 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.136866 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.137174 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.137501 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.137878 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.138151 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.138537 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.138982 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.139312 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.139680 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.140002 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.140478 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.140809 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.141041 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.141304 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.141576 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.141899 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.142226 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.142747 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.143081 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.143401 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.143734 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.144094 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.144402 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.145566 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.145566 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.145566 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.145566 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.146461 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.146461 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.147446 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.147446 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.147918 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.148143 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.148383 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.148628 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.148941 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.149274 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.149674 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.150006 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.150333 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.150646 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.150976 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.151291 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.151676 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.152020 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.152331 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.152682 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.152998 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.153319 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.153663 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.153992 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.154313 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.154899 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.155244 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.155569 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.155907 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.156234 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.156563 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.156875 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.157181 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.157497 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.157804 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.158120 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.158422 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.158737 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.159051 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.159357 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.159664 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.160021 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.160330 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.160652 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.160963 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.161274 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.161589 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.161968 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.162475 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.162788 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.163129 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.163445 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.163900 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.164271 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.164632 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.164875 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.165239 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.165567 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.165893 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.166211 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.166530 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.166926 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.167246 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.167805 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.168388 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.168798 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.169125 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.169449 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.169765 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.170082 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.170401 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.170718 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.171032 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.171346 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.171659 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.172023 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.172349 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.172676 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.173017 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.173339 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.173665 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.173981 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.174301 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.174663 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.174982 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.175292 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.175609 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.175953 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.176353 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.176673 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.176990 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.177307 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.177623 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.178027 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.178343 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.178658 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.178990 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.179321 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.179661 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.180102 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.180354 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.180638 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.180961 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.181522 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.181839 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.182173 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.182596 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.182931 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.183333 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.183670 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.184108 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.184427 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.184735 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.185110 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.185460 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.185842 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.186092 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.186558 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.186942 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.187273 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.187634 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.188324 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.188711 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.189084 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.189474 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.189878 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.190277 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.190641 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.190999 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.191312 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.191626 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.191976 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.192370 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.192645 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.193004 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.193327 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.194177 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.194486 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.194879 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.195197 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.195600 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.195953 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.196269 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.196579 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.196974 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.197290 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.197671 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.197989 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.198363 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.198706 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.199077 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.199465 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.199829 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.200218 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.200645 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.201063 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.201408 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.201824 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.202209 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.202526 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.202930 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.203253 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.203679 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.204105 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.204487 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.204926 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.205259 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.205971 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.206391 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.206743 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.207104 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.207509 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.207887 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.208279 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.208674 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.209083 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.209959 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.210325 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.210675 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.211061 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.211217 dv-cinder-zed-3-smb devstack@n-api.service[112028]: INFO dbcounter [None req-721f499c-ff9d-4a6f-b9f9-81df75756faf None None] Registered counter for database nova_api Oct 28 09:36:38.211442 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.211843 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.212215 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.212627 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.212953 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.213348 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.213741 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.214114 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.214505 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.215153 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.215541 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.215988 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.216392 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.216785 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.217128 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.217454 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.217774 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.218095 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.218418 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.218736 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.219070 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.219397 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.219734 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.220163 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.220932 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.221337 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.221780 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.222129 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.222500 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.222926 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.223332 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.223659 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.224071 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.224417 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.224706 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.225086 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.226245 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.226245 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.226245 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.226467 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.226731 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.227045 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.227436 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.227851 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.228189 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.228469 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.228788 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.229102 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.229415 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.229863 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.230121 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.230438 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.230750 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.231061 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.231589 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.231885 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.232509 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.232509 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.233050 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.233050 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.233703 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.233703 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.234217 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.234506 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.234785 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.235210 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.235539 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG oslo_db.sqlalchemy.engines [None req-721f499c-ff9d-4a6f-b9f9-81df75756faf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112028) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 28 09:36:38.235936 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.236227 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.236611 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.237040 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.237435 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.237806 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.238186 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.238515 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.238861 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.239174 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.239520 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.239910 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.240256 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.240600 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.240918 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.241253 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.241629 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.242043 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.242445 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.242681 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG dbcounter [-] [112028] Writer thread running {{(pid=112028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 28 09:36:38.242917 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.243240 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.243480 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.243800 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.244179 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.244505 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.244914 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.245245 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.245640 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.246057 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.246456 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.246787 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.247180 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.247539 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.247940 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.248310 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.248727 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.249099 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.249449 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.249836 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.250250 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.250681 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.251035 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.251563 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.251909 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.252252 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.252635 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.253022 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:36:38.253322 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 28 09:36:38.303236 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.context [None req-721f499c-ff9d-4a6f-b9f9-81df75756faf None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2b15302a-f4a0-4e7f-8af3-7ee6eb916adf(cell1) {{(pid=112028) load_cells /opt/stack/nova/nova/context.py:464}} Oct 28 09:36:38.307513 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG oslo_concurrency.lockutils [None req-721f499c-ff9d-4a6f-b9f9-81df75756faf None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:36:38.308036 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG oslo_concurrency.lockutils [None req-721f499c-ff9d-4a6f-b9f9-81df75756faf None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:36:38.309709 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG oslo_concurrency.lockutils [None req-721f499c-ff9d-4a6f-b9f9-81df75756faf None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:36:38.310513 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG oslo_concurrency.lockutils [None req-721f499c-ff9d-4a6f-b9f9-81df75756faf None None] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:36:38.310968 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG oslo_concurrency.lockutils [None req-721f499c-ff9d-4a6f-b9f9-81df75756faf None None] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:36:38.313186 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG oslo_concurrency.lockutils [None req-721f499c-ff9d-4a6f-b9f9-81df75756faf None None] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:36:38.315382 dv-cinder-zed-3-smb devstack@n-api.service[112028]: INFO dbcounter [None req-721f499c-ff9d-4a6f-b9f9-81df75756faf None None] Registered counter for database nova_cell0 Oct 28 09:36:38.320756 dv-cinder-zed-3-smb devstack@n-api.service[112028]: INFO dbcounter [None req-721f499c-ff9d-4a6f-b9f9-81df75756faf None None] Registered counter for database nova_cell1 Oct 28 09:36:38.329445 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG oslo_db.sqlalchemy.engines [None req-721f499c-ff9d-4a6f-b9f9-81df75756faf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112028) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 28 09:36:38.331287 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG oslo_db.sqlalchemy.engines [None req-721f499c-ff9d-4a6f-b9f9-81df75756faf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112028) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 28 09:36:38.337828 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG dbcounter [-] [112028] Writer thread running {{(pid=112028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 28 09:36:38.341098 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG dbcounter [-] [112028] Writer thread running {{(pid=112028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 28 09:36:38.412832 dv-cinder-zed-3-smb devstack@n-api.service[112029]: INFO dbcounter [None req-e0f000d3-86ca-464b-b053-6bb953c4ff98 None None] Registered counter for database nova_api Oct 28 09:36:38.436647 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG oslo_db.sqlalchemy.engines [None req-e0f000d3-86ca-464b-b053-6bb953c4ff98 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112029) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 28 09:36:38.445041 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG dbcounter [-] [112029] Writer thread running {{(pid=112029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 28 09:36:38.491280 dv-cinder-zed-3-smb devstack@n-api.service[112028]: INFO dbcounter [None req-721f499c-ff9d-4a6f-b9f9-81df75756faf None None] Registered counter for database nova_cell0 Oct 28 09:36:38.499647 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG oslo_db.sqlalchemy.engines [None req-721f499c-ff9d-4a6f-b9f9-81df75756faf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112028) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 28 09:36:38.504747 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG dbcounter [-] [112028] Writer thread running {{(pid=112028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 28 09:36:38.511655 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.context [None req-e0f000d3-86ca-464b-b053-6bb953c4ff98 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2b15302a-f4a0-4e7f-8af3-7ee6eb916adf(cell1) {{(pid=112029) load_cells /opt/stack/nova/nova/context.py:464}} Oct 28 09:36:38.516196 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG oslo_concurrency.lockutils [None req-e0f000d3-86ca-464b-b053-6bb953c4ff98 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:36:38.516735 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG oslo_concurrency.lockutils [None req-e0f000d3-86ca-464b-b053-6bb953c4ff98 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:36:38.518464 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG oslo_concurrency.lockutils [None req-e0f000d3-86ca-464b-b053-6bb953c4ff98 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:36:38.519320 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG oslo_concurrency.lockutils [None req-e0f000d3-86ca-464b-b053-6bb953c4ff98 None None] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:36:38.519796 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG oslo_concurrency.lockutils [None req-e0f000d3-86ca-464b-b053-6bb953c4ff98 None None] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:36:38.522077 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG oslo_concurrency.lockutils [None req-e0f000d3-86ca-464b-b053-6bb953c4ff98 None None] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:36:38.524579 dv-cinder-zed-3-smb devstack@n-api.service[112029]: INFO dbcounter [None req-e0f000d3-86ca-464b-b053-6bb953c4ff98 None None] Registered counter for database nova_cell0 Oct 28 09:36:38.529837 dv-cinder-zed-3-smb devstack@n-api.service[112029]: INFO dbcounter [None req-e0f000d3-86ca-464b-b053-6bb953c4ff98 None None] Registered counter for database nova_cell1 Oct 28 09:36:38.540818 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG oslo_db.sqlalchemy.engines [None req-e0f000d3-86ca-464b-b053-6bb953c4ff98 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112029) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 28 09:36:38.542389 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG oslo_db.sqlalchemy.engines [None req-e0f000d3-86ca-464b-b053-6bb953c4ff98 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112029) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 28 09:36:38.549484 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG dbcounter [-] [112029] Writer thread running {{(pid=112029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 28 09:36:38.550983 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG dbcounter [-] [112029] Writer thread running {{(pid=112029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 28 09:36:38.709415 dv-cinder-zed-3-smb devstack@n-api.service[112029]: INFO dbcounter [None req-e0f000d3-86ca-464b-b053-6bb953c4ff98 None None] Registered counter for database nova_cell0 Oct 28 09:36:38.719537 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG oslo_db.sqlalchemy.engines [None req-e0f000d3-86ca-464b-b053-6bb953c4ff98 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112029) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 28 09:36:38.724719 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG dbcounter [-] [112029] Writer thread running {{(pid=112029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 28 09:36:38.850380 dv-cinder-zed-3-smb devstack@n-api.service[112028]: WARNING keystonemiddleware.auth_token [None req-721f499c-ff9d-4a6f-b9f9-81df75756faf None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 28 09:36:38.857928 dv-cinder-zed-3-smb devstack@n-api.service[112028]: WARNING keystonemiddleware.auth_token [None req-721f499c-ff9d-4a6f-b9f9-81df75756faf None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 28 09:36:39.091329 dv-cinder-zed-3-smb devstack@n-api.service[112029]: WARNING keystonemiddleware.auth_token [None req-e0f000d3-86ca-464b-b053-6bb953c4ff98 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 28 09:36:39.100574 dv-cinder-zed-3-smb devstack@n-api.service[112029]: WARNING keystonemiddleware.auth_token [None req-e0f000d3-86ca-464b-b053-6bb953c4ff98 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 28 09:36:39.204549 dv-cinder-zed-3-smb devstack@n-api.service[112028]: WARNING keystonemiddleware.auth_token [None req-721f499c-ff9d-4a6f-b9f9-81df75756faf None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 28 09:36:39.211201 dv-cinder-zed-3-smb devstack@n-api.service[112028]: WARNING keystonemiddleware.auth_token [None req-721f499c-ff9d-4a6f-b9f9-81df75756faf None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 28 09:36:39.216963 dv-cinder-zed-3-smb devstack@n-api.service[112028]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x561da54329c0 pid: 112028 (default app) Oct 28 09:36:39.219118 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi [None req-721f499c-ff9d-4a6f-b9f9-81df75756faf None None] Calling method '>' {{(pid=112028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:36:39.220377 dv-cinder-zed-3-smb devstack@n-api.service[112028]: INFO nova.api.openstack.requestlog [None req-721f499c-ff9d-4a6f-b9f9-81df75756faf None None] 10.222.0.52 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001846 Oct 28 09:36:39.220839 dv-cinder-zed-3-smb devstack@n-api.service[112028]: [pid: 112028|app: 0|req: 1/1] 10.222.0.52 () {50 vars in 788 bytes} [Fri Oct 28 09:36:39 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:36:39.484945 dv-cinder-zed-3-smb devstack@n-api.service[112029]: WARNING keystonemiddleware.auth_token [None req-e0f000d3-86ca-464b-b053-6bb953c4ff98 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 28 09:36:39.492563 dv-cinder-zed-3-smb devstack@n-api.service[112029]: WARNING keystonemiddleware.auth_token [None req-e0f000d3-86ca-464b-b053-6bb953c4ff98 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 28 09:36:39.498471 dv-cinder-zed-3-smb devstack@n-api.service[112029]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x561da54329c0 pid: 112029 (default app) Oct 28 09:38:04.761519 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi [None req-721f499c-ff9d-4a6f-b9f9-81df75756faf None None] Calling method '>' {{(pid=112028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:38:04.762581 dv-cinder-zed-3-smb devstack@n-api.service[112028]: INFO nova.api.openstack.requestlog [None req-721f499c-ff9d-4a6f-b9f9-81df75756faf None None] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001888 Oct 28 09:38:04.763224 dv-cinder-zed-3-smb devstack@n-api.service[112028]: [pid: 112028|app: 0|req: 2/2] 10.222.0.52 () {54 vars in 931 bytes} [Fri Oct 28 09:38:04 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:38:04.776936 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG dbcounter [-] [112029] Writing DB stats nova_api:SELECT=3 {{(pid=112029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:38:04.778355 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG dbcounter [-] [112029] Writing DB stats nova_cell1:SELECT=3 {{(pid=112029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:38:04.779184 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG dbcounter [-] [112029] Writing DB stats nova_cell0:SELECT=3 {{(pid=112029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:38:04.780128 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG dbcounter [-] [112029] Writing DB stats nova_cell0:SELECT=3 {{(pid=112029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:38:05.743060 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi [None req-daf9b3af-8050-4e90-84e7-de91c22af26e admin admin] Calling method '>' {{(pid=112029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:38:05.776106 dv-cinder-zed-3-smb devstack@n-api.service[112029]: INFO nova.api.openstack.requestlog [None req-daf9b3af-8050-4e90-84e7-de91c22af26e admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 1.005368 Oct 28 09:38:05.776844 dv-cinder-zed-3-smb devstack@n-api.service[112029]: [pid: 112029|app: 0|req: 1/3] 10.222.0.52 () {60 vars in 1292 bytes} [Fri Oct 28 09:38:04 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:38:08.437530 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi [None req-721f499c-ff9d-4a6f-b9f9-81df75756faf None None] Calling method '>' {{(pid=112028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:38:08.438545 dv-cinder-zed-3-smb devstack@n-api.service[112028]: INFO nova.api.openstack.requestlog [None req-721f499c-ff9d-4a6f-b9f9-81df75756faf None None] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 Oct 28 09:38:08.439124 dv-cinder-zed-3-smb devstack@n-api.service[112028]: [pid: 112028|app: 0|req: 3/4] 10.222.0.52 () {54 vars in 931 bytes} [Fri Oct 28 09:38:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:38:08.923486 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi [None req-29eac698-4591-4ee0-b3cf-144b27d5e9cb admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "swap": 0, "vcpus": 1, "disk": 1, "rxtx_factor": 1.0, "id": "c1", "os-flavor-access:is_public": true, "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=112029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:38:08.984059 dv-cinder-zed-3-smb devstack@n-api.service[112029]: INFO nova.api.openstack.requestlog [None req-29eac698-4591-4ee0-b3cf-144b27d5e9cb admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.538009 Oct 28 09:38:08.988782 dv-cinder-zed-3-smb devstack@n-api.service[112029]: [pid: 112029|app: 0|req: 2/5] 10.222.0.52 () {64 vars in 1283 bytes} [Fri Oct 28 09:38:08 2022] POST /compute/v2.1/flavors => generated 407 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 09:38:08.998279 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG dbcounter [-] [112028] Writing DB stats nova_api:SELECT=3 {{(pid=112028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:38:08.999141 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG dbcounter [-] [112028] Writing DB stats nova_cell1:SELECT=3 {{(pid=112028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:38:09.001111 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG dbcounter [-] [112028] Writing DB stats nova_cell0:SELECT=3 {{(pid=112028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:38:09.001862 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG dbcounter [-] [112028] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=112028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:38:09.206884 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi [None req-9704b30a-2c4a-40b3-9a7e-8fc05cabf1fd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:38:09.276224 dv-cinder-zed-3-smb devstack@n-api.service[112028]: INFO nova.api.openstack.requestlog [None req-9704b30a-2c4a-40b3-9a7e-8fc05cabf1fd admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.283080 Oct 28 09:38:09.276916 dv-cinder-zed-3-smb devstack@n-api.service[112028]: [pid: 112028|app: 0|req: 4/6] 10.222.0.52 () {64 vars in 1336 bytes} [Fri Oct 28 09:38:08 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:38:11.954919 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi [None req-29eac698-4591-4ee0-b3cf-144b27d5e9cb admin admin] Calling method '>' {{(pid=112029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:38:11.955967 dv-cinder-zed-3-smb devstack@n-api.service[112029]: INFO nova.api.openstack.requestlog [None req-29eac698-4591-4ee0-b3cf-144b27d5e9cb admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001485 Oct 28 09:38:11.956578 dv-cinder-zed-3-smb devstack@n-api.service[112029]: [pid: 112029|app: 0|req: 3/7] 10.222.0.52 () {54 vars in 931 bytes} [Fri Oct 28 09:38:11 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 09:38:12.743622 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi [None req-29ea2912-e90a-4f52-b27a-82b8c8e4416f admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d1", "ram": 512, "name": "ds512M", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 5, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=112028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:38:12.795102 dv-cinder-zed-3-smb devstack@n-api.service[112028]: INFO nova.api.openstack.requestlog [None req-29ea2912-e90a-4f52-b27a-82b8c8e4416f admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.831269 Oct 28 09:38:12.796053 dv-cinder-zed-3-smb devstack@n-api.service[112028]: [pid: 112028|app: 0|req: 5/8] 10.222.0.52 () {64 vars in 1283 bytes} [Fri Oct 28 09:38:11 2022] POST /compute/v2.1/flavors => generated 404 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 09:38:12.810029 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi [None req-d221201b-5270-46eb-996f-beba41b563a3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:38:12.858748 dv-cinder-zed-3-smb devstack@n-api.service[112029]: INFO nova.api.openstack.requestlog [None req-d221201b-5270-46eb-996f-beba41b563a3 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.052890 Oct 28 09:38:12.859307 dv-cinder-zed-3-smb devstack@n-api.service[112029]: [pid: 112029|app: 0|req: 4/9] 10.222.0.52 () {64 vars in 1336 bytes} [Fri Oct 28 09:38:12 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:38:16.059504 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi [None req-29ea2912-e90a-4f52-b27a-82b8c8e4416f admin admin] Calling method '>' {{(pid=112028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:38:16.060589 dv-cinder-zed-3-smb devstack@n-api.service[112028]: INFO nova.api.openstack.requestlog [None req-29ea2912-e90a-4f52-b27a-82b8c8e4416f admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001527 Oct 28 09:38:16.061003 dv-cinder-zed-3-smb devstack@n-api.service[112028]: [pid: 112028|app: 0|req: 6/10] 10.222.0.52 () {54 vars in 931 bytes} [Fri Oct 28 09:38:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:38:16.655476 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi [None req-1d6e9f58-b34f-40af-800c-72ebc2aeee5e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d2", "vcpus": 1, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "ram": 1024, "swap": 0}} {{(pid=112029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:38:16.675657 dv-cinder-zed-3-smb devstack@n-api.service[112029]: INFO nova.api.openstack.requestlog [None req-1d6e9f58-b34f-40af-800c-72ebc2aeee5e admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.607486 Oct 28 09:38:16.676306 dv-cinder-zed-3-smb devstack@n-api.service[112029]: [pid: 112029|app: 0|req: 5/11] 10.222.0.52 () {64 vars in 1283 bytes} [Fri Oct 28 09:38:16 2022] POST /compute/v2.1/flavors => generated 404 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 09:38:16.689594 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi [None req-4fbecb93-5c84-4df9-a137-74379158489f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:38:16.719851 dv-cinder-zed-3-smb devstack@n-api.service[112028]: INFO nova.api.openstack.requestlog [None req-4fbecb93-5c84-4df9-a137-74379158489f admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034359 Oct 28 09:38:16.720437 dv-cinder-zed-3-smb devstack@n-api.service[112028]: [pid: 112028|app: 0|req: 7/12] 10.222.0.52 () {64 vars in 1336 bytes} [Fri Oct 28 09:38:16 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:38:19.475704 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi [None req-1d6e9f58-b34f-40af-800c-72ebc2aeee5e admin admin] Calling method '>' {{(pid=112029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:38:19.477398 dv-cinder-zed-3-smb devstack@n-api.service[112029]: INFO nova.api.openstack.requestlog [None req-1d6e9f58-b34f-40af-800c-72ebc2aeee5e admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002112 Oct 28 09:38:19.477818 dv-cinder-zed-3-smb devstack@n-api.service[112029]: [pid: 112029|app: 0|req: 6/13] 10.222.0.52 () {54 vars in 931 bytes} [Fri Oct 28 09:38:19 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:38:19.999832 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi [None req-65fa474f-c526-4fc2-9029-54ca32364d7f admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "d3", "vcpus": 2, "disk": 10, "name": "ds2G", "ram": 2048}} {{(pid=112028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:38:20.024464 dv-cinder-zed-3-smb devstack@n-api.service[112028]: INFO nova.api.openstack.requestlog [None req-65fa474f-c526-4fc2-9029-54ca32364d7f admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.539371 Oct 28 09:38:20.025186 dv-cinder-zed-3-smb devstack@n-api.service[112028]: [pid: 112028|app: 0|req: 8/14] 10.222.0.52 () {64 vars in 1283 bytes} [Fri Oct 28 09:38:19 2022] POST /compute/v2.1/flavors => generated 404 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 09:38:20.041301 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi [None req-b7e12f15-6baa-4c31-aca2-91098e8999a5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:38:20.076583 dv-cinder-zed-3-smb devstack@n-api.service[112029]: INFO nova.api.openstack.requestlog [None req-b7e12f15-6baa-4c31-aca2-91098e8999a5 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042167 Oct 28 09:38:20.091897 dv-cinder-zed-3-smb devstack@n-api.service[112029]: [pid: 112029|app: 0|req: 7/15] 10.222.0.52 () {64 vars in 1336 bytes} [Fri Oct 28 09:38:20 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:38:22.881386 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi [None req-65fa474f-c526-4fc2-9029-54ca32364d7f admin admin] Calling method '>' {{(pid=112028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:38:22.882338 dv-cinder-zed-3-smb devstack@n-api.service[112028]: INFO nova.api.openstack.requestlog [None req-65fa474f-c526-4fc2-9029-54ca32364d7f admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001506 Oct 28 09:38:22.882756 dv-cinder-zed-3-smb devstack@n-api.service[112028]: [pid: 112028|app: 0|req: 9/16] 10.222.0.52 () {54 vars in 931 bytes} [Fri Oct 28 09:38:22 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:38:23.472171 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi [None req-d1908e91-733b-431f-abe1-19cec93b22db admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G", "os-flavor-access:is_public": true, "swap": 0, "disk": 20, "rxtx_factor": 1.0, "id": "d4", "vcpus": 4}} {{(pid=112029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:38:23.496677 dv-cinder-zed-3-smb devstack@n-api.service[112029]: INFO nova.api.openstack.requestlog [None req-d1908e91-733b-431f-abe1-19cec93b22db admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.606775 Oct 28 09:38:23.497230 dv-cinder-zed-3-smb devstack@n-api.service[112029]: [pid: 112029|app: 0|req: 8/17] 10.222.0.52 () {64 vars in 1283 bytes} [Fri Oct 28 09:38:22 2022] POST /compute/v2.1/flavors => generated 404 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 09:38:23.509474 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi [None req-3a211ccd-0f3f-4acd-a1ab-624eb62d2fba admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:38:23.536435 dv-cinder-zed-3-smb devstack@n-api.service[112028]: INFO nova.api.openstack.requestlog [None req-3a211ccd-0f3f-4acd-a1ab-624eb62d2fba admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030026 Oct 28 09:38:23.537029 dv-cinder-zed-3-smb devstack@n-api.service[112028]: [pid: 112028|app: 0|req: 10/18] 10.222.0.52 () {64 vars in 1336 bytes} [Fri Oct 28 09:38:23 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:38:26.587243 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi [None req-d1908e91-733b-431f-abe1-19cec93b22db admin admin] Calling method '>' {{(pid=112029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:38:26.588243 dv-cinder-zed-3-smb devstack@n-api.service[112029]: INFO nova.api.openstack.requestlog [None req-d1908e91-733b-431f-abe1-19cec93b22db admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001534 Oct 28 09:38:26.588661 dv-cinder-zed-3-smb devstack@n-api.service[112029]: [pid: 112029|app: 0|req: 9/19] 10.222.0.52 () {54 vars in 931 bytes} [Fri Oct 28 09:38:26 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:38:27.159514 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi [None req-9bb06dd7-ab51-49db-adae-1cca566c5f77 admin admin] Calling method '>' {{(pid=112028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:38:27.186069 dv-cinder-zed-3-smb devstack@n-api.service[112028]: INFO nova.api.openstack.requestlog [None req-9bb06dd7-ab51-49db-adae-1cca566c5f77 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.590162 Oct 28 09:38:27.186624 dv-cinder-zed-3-smb devstack@n-api.service[112028]: [pid: 112028|app: 0|req: 11/20] 10.222.0.52 () {60 vars in 1292 bytes} [Fri Oct 28 09:38:26 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:38:30.009703 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi [None req-d1908e91-733b-431f-abe1-19cec93b22db admin admin] Calling method '>' {{(pid=112029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:38:30.011198 dv-cinder-zed-3-smb devstack@n-api.service[112029]: INFO nova.api.openstack.requestlog [None req-d1908e91-733b-431f-abe1-19cec93b22db admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001873 Oct 28 09:38:30.011731 dv-cinder-zed-3-smb devstack@n-api.service[112029]: [pid: 112029|app: 0|req: 10/21] 10.222.0.52 () {54 vars in 931 bytes} [Fri Oct 28 09:38:30 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:38:30.566608 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi [None req-f156949e-1bbc-4514-87b3-e2c68cdf1106 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "rxtx_factor": 1.0, "ram": 512, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "os-flavor-access:is_public": true, "vcpus": 1, "id": "1"}} {{(pid=112028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:38:30.594157 dv-cinder-zed-3-smb devstack@n-api.service[112028]: INFO nova.api.openstack.requestlog [None req-f156949e-1bbc-4514-87b3-e2c68cdf1106 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.574838 Oct 28 09:38:30.594859 dv-cinder-zed-3-smb devstack@n-api.service[112028]: [pid: 112028|app: 0|req: 12/22] 10.222.0.52 () {64 vars in 1283 bytes} [Fri Oct 28 09:38:30 2022] POST /compute/v2.1/flavors => generated 402 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 09:38:30.614978 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi [None req-e9abb8a7-da52-499d-9d1a-9813600be712 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:38:30.648527 dv-cinder-zed-3-smb devstack@n-api.service[112029]: INFO nova.api.openstack.requestlog [None req-e9abb8a7-da52-499d-9d1a-9813600be712 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038433 Oct 28 09:38:30.649238 dv-cinder-zed-3-smb devstack@n-api.service[112029]: [pid: 112029|app: 0|req: 11/23] 10.222.0.52 () {64 vars in 1333 bytes} [Fri Oct 28 09:38:30 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:38:34.155695 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi [None req-f156949e-1bbc-4514-87b3-e2c68cdf1106 admin admin] Calling method '>' {{(pid=112028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:38:34.156721 dv-cinder-zed-3-smb devstack@n-api.service[112028]: INFO nova.api.openstack.requestlog [None req-f156949e-1bbc-4514-87b3-e2c68cdf1106 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Oct 28 09:38:34.157133 dv-cinder-zed-3-smb devstack@n-api.service[112028]: [pid: 112028|app: 0|req: 13/24] 10.222.0.52 () {54 vars in 931 bytes} [Fri Oct 28 09:38:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:38:34.861347 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi [None req-617a417c-c35f-404d-958c-b3bdf6b8fae1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "vcpus": 1, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "m1.small", "rxtx_factor": 1.0, "id": "2", "os-flavor-access:is_public": true}} {{(pid=112029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:38:34.873129 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG dbcounter [-] [112029] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=6,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=112029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:38:34.900624 dv-cinder-zed-3-smb devstack@n-api.service[112029]: INFO nova.api.openstack.requestlog [None req-617a417c-c35f-404d-958c-b3bdf6b8fae1 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.736670 Oct 28 09:38:34.912828 dv-cinder-zed-3-smb devstack@n-api.service[112029]: [pid: 112029|app: 0|req: 12/25] 10.222.0.52 () {64 vars in 1283 bytes} [Fri Oct 28 09:38:34 2022] POST /compute/v2.1/flavors => generated 405 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 09:38:34.922806 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi [None req-6156faf6-b1fb-4fa7-ae16-7dbec4f321de admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:38:34.955495 dv-cinder-zed-3-smb devstack@n-api.service[112028]: INFO nova.api.openstack.requestlog [None req-6156faf6-b1fb-4fa7-ae16-7dbec4f321de admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038511 Oct 28 09:38:34.956229 dv-cinder-zed-3-smb devstack@n-api.service[112028]: [pid: 112028|app: 0|req: 14/26] 10.222.0.52 () {64 vars in 1333 bytes} [Fri Oct 28 09:38:34 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:38:37.729573 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi [None req-617a417c-c35f-404d-958c-b3bdf6b8fae1 admin admin] Calling method '>' {{(pid=112029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:38:37.731557 dv-cinder-zed-3-smb devstack@n-api.service[112029]: INFO nova.api.openstack.requestlog [None req-617a417c-c35f-404d-958c-b3bdf6b8fae1 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002451 Oct 28 09:38:37.737687 dv-cinder-zed-3-smb devstack@n-api.service[112029]: [pid: 112029|app: 0|req: 13/27] 10.222.0.52 () {54 vars in 931 bytes} [Fri Oct 28 09:38:37 2022] GET /compute/v2.1 => generated 388 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:38:38.334094 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi [None req-420208a2-4049-4292-a272-5ea0354319ab admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "id": "3", "rxtx_factor": 1.0, "vcpus": 2, "disk": 40, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "m1.medium"}} {{(pid=112028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:38:38.356309 dv-cinder-zed-3-smb devstack@n-api.service[112028]: INFO nova.api.openstack.requestlog [None req-420208a2-4049-4292-a272-5ea0354319ab admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.617009 Oct 28 09:38:38.357476 dv-cinder-zed-3-smb devstack@n-api.service[112028]: [pid: 112028|app: 0|req: 15/28] 10.222.0.52 () {64 vars in 1283 bytes} [Fri Oct 28 09:38:37 2022] POST /compute/v2.1/flavors => generated 406 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 09:38:38.371692 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi [None req-cbd5a2d6-9f18-4c51-95a9-407ce1553565 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:38:38.400770 dv-cinder-zed-3-smb devstack@n-api.service[112029]: INFO nova.api.openstack.requestlog [None req-cbd5a2d6-9f18-4c51-95a9-407ce1553565 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034343 Oct 28 09:38:38.402063 dv-cinder-zed-3-smb devstack@n-api.service[112029]: [pid: 112029|app: 0|req: 14/29] 10.222.0.52 () {64 vars in 1333 bytes} [Fri Oct 28 09:38:38 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:38:41.476593 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi [None req-420208a2-4049-4292-a272-5ea0354319ab admin admin] Calling method '>' {{(pid=112028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:38:41.478385 dv-cinder-zed-3-smb devstack@n-api.service[112028]: INFO nova.api.openstack.requestlog [None req-420208a2-4049-4292-a272-5ea0354319ab admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002570 Oct 28 09:38:41.479145 dv-cinder-zed-3-smb devstack@n-api.service[112028]: [pid: 112028|app: 0|req: 16/30] 10.222.0.52 () {54 vars in 931 bytes} [Fri Oct 28 09:38:41 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:38:42.114879 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi [None req-d66c0a95-d5b7-4923-8c07-b8aa216ef483 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 8192, "name": "m1.large", "os-flavor-access:is_public": true, "id": "4", "vcpus": 4, "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=112029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:38:42.145639 dv-cinder-zed-3-smb devstack@n-api.service[112029]: INFO nova.api.openstack.requestlog [None req-d66c0a95-d5b7-4923-8c07-b8aa216ef483 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.655756 Oct 28 09:38:42.147857 dv-cinder-zed-3-smb devstack@n-api.service[112029]: [pid: 112029|app: 0|req: 15/31] 10.222.0.52 () {64 vars in 1283 bytes} [Fri Oct 28 09:38:41 2022] POST /compute/v2.1/flavors => generated 405 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 09:38:42.160977 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi [None req-31a1b907-a237-4120-9d82-e0c31bf891df admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:38:42.166404 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG dbcounter [-] [112028] Writing DB stats nova_api:SELECT=39,nova_api:SAVEPOINT=4,nova_api:INSERT=8,nova_api:RELEASE=4 {{(pid=112028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:38:42.192189 dv-cinder-zed-3-smb devstack@n-api.service[112028]: INFO nova.api.openstack.requestlog [None req-31a1b907-a237-4120-9d82-e0c31bf891df admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036777 Oct 28 09:38:42.200246 dv-cinder-zed-3-smb devstack@n-api.service[112028]: [pid: 112028|app: 0|req: 17/32] 10.222.0.52 () {64 vars in 1333 bytes} [Fri Oct 28 09:38:42 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:38:45.016309 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi [None req-d66c0a95-d5b7-4923-8c07-b8aa216ef483 admin admin] Calling method '>' {{(pid=112029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:38:45.017875 dv-cinder-zed-3-smb devstack@n-api.service[112029]: INFO nova.api.openstack.requestlog [None req-d66c0a95-d5b7-4923-8c07-b8aa216ef483 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002748 Oct 28 09:38:45.018771 dv-cinder-zed-3-smb devstack@n-api.service[112029]: [pid: 112029|app: 0|req: 16/33] 10.222.0.52 () {54 vars in 931 bytes} [Fri Oct 28 09:38:45 2022] GET /compute/v2.1 => generated 388 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:38:45.581897 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi [None req-c1d5ab32-46e8-442a-9fa5-9e7ed8f06fa5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "name": "m1.xlarge", "disk": 160, "id": "5", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=112028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:38:45.601287 dv-cinder-zed-3-smb devstack@n-api.service[112028]: INFO nova.api.openstack.requestlog [None req-c1d5ab32-46e8-442a-9fa5-9e7ed8f06fa5 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.574611 Oct 28 09:38:45.602018 dv-cinder-zed-3-smb devstack@n-api.service[112028]: [pid: 112028|app: 0|req: 18/34] 10.222.0.52 () {64 vars in 1283 bytes} [Fri Oct 28 09:38:45 2022] POST /compute/v2.1/flavors => generated 408 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 09:38:45.614673 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi [None req-f0a7af9b-5d3a-42e8-8201-851ffcb72109 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:38:45.643262 dv-cinder-zed-3-smb devstack@n-api.service[112029]: INFO nova.api.openstack.requestlog [None req-f0a7af9b-5d3a-42e8-8201-851ffcb72109 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032735 Oct 28 09:38:45.644136 dv-cinder-zed-3-smb devstack@n-api.service[112029]: [pid: 112029|app: 0|req: 17/35] 10.222.0.52 () {64 vars in 1333 bytes} [Fri Oct 28 09:38:45 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:39:00.371279 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi [None req-c1d5ab32-46e8-442a-9fa5-9e7ed8f06fa5 admin admin] Calling method '>' {{(pid=112028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:39:00.372551 dv-cinder-zed-3-smb devstack@n-api.service[112028]: INFO nova.api.openstack.requestlog [None req-c1d5ab32-46e8-442a-9fa5-9e7ed8f06fa5 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001676 Oct 28 09:39:00.373264 dv-cinder-zed-3-smb devstack@n-api.service[112028]: [pid: 112028|app: 0|req: 19/36] 10.222.0.52 () {54 vars in 931 bytes} [Fri Oct 28 09:39:00 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:39:00.390105 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG dbcounter [-] [112029] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=17,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=112029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:39:00.880474 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi [None req-37f8da97-601d-4a3e-bbff-8cbc2d7a5aa5 admin admin] Calling method '>' {{(pid=112029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:39:00.902372 dv-cinder-zed-3-smb devstack@n-api.service[112029]: INFO nova.api.openstack.requestlog [None req-37f8da97-601d-4a3e-bbff-8cbc2d7a5aa5 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.518897 Oct 28 09:39:00.902929 dv-cinder-zed-3-smb devstack@n-api.service[112029]: [pid: 112029|app: 0|req: 18/37] 10.222.0.52 () {60 vars in 1292 bytes} [Fri Oct 28 09:39:00 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:39:02.291900 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi [None req-c1d5ab32-46e8-442a-9fa5-9e7ed8f06fa5 admin admin] Calling method '>' {{(pid=112028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:39:02.292918 dv-cinder-zed-3-smb devstack@n-api.service[112028]: INFO nova.api.openstack.requestlog [None req-c1d5ab32-46e8-442a-9fa5-9e7ed8f06fa5 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 Oct 28 09:39:02.293330 dv-cinder-zed-3-smb devstack@n-api.service[112028]: [pid: 112028|app: 0|req: 20/38] 10.222.0.52 () {56 vars in 1074 bytes} [Fri Oct 28 09:39:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:39:03.016102 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi [None req-a8be78c4-d1d8-417d-b847-e50d839dcab3 admin admin] Calling method '>' {{(pid=112029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:39:03.021652 dv-cinder-zed-3-smb devstack@n-api.service[112029]: INFO nova.api.openstack.wsgi [None req-a8be78c4-d1d8-417d-b847-e50d839dcab3 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 28 09:39:03.024874 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi [None req-a8be78c4-d1d8-417d-b847-e50d839dcab3 admin admin] Request method failure captured: Oct 28 09:39:03.024874 dv-cinder-zed-3-smb devstack@n-api.service[112029]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 28 09:39:03.024874 dv-cinder-zed-3-smb devstack@n-api.service[112029]: Accept: application/json Oct 28 09:39:03.024874 dv-cinder-zed-3-smb devstack@n-api.service[112029]: Accept-Encoding: gzip, deflate Oct 28 09:39:03.024874 dv-cinder-zed-3-smb devstack@n-api.service[112029]: Connection: keep-alive Oct 28 09:39:03.024874 dv-cinder-zed-3-smb devstack@n-api.service[112029]: Content-Length: 0 Oct 28 09:39:03.024874 dv-cinder-zed-3-smb devstack@n-api.service[112029]: Host: 10.222.0.52 Oct 28 09:39:03.024874 dv-cinder-zed-3-smb devstack@n-api.service[112029]: Openstack-Api-Version: compute 2.92 Oct 28 09:39:03.024874 dv-cinder-zed-3-smb devstack@n-api.service[112029]: Openstack-System-Scope: None Oct 28 09:39:03.024874 dv-cinder-zed-3-smb devstack@n-api.service[112029]: User-Agent: python-novaclient Oct 28 09:39:03.024874 dv-cinder-zed-3-smb devstack@n-api.service[112029]: X-Auth-Token: gAAAAABjW6M2yKGblseww104x3gt6c1Vy47zDRyQFc3iHvxZhyp5qLYBIEdKOdbqNwyFYQXv-1Rn0kUUt0d9FJxIg_Z6DnQu5Rna0yoXbe0hO5Ppn1DvHaj6zUY9C74RzDD2SSQxyM2X3T52ZRWd7khCcQK1e49Rz-Vh6vn_37C_pnq5Pw7wyfw Oct 28 09:39:03.024874 dv-cinder-zed-3-smb devstack@n-api.service[112029]: X-Domain-Id: None Oct 28 09:39:03.024874 dv-cinder-zed-3-smb devstack@n-api.service[112029]: X-Domain-Name: None Oct 28 09:39:03.024874 dv-cinder-zed-3-smb devstack@n-api.service[112029]: X-Identity-Status: Confirmed Oct 28 09:39:03.024874 dv-cinder-zed-3-smb devstack@n-api.service[112029]: X-Is-Admin-Project: True Oct 28 09:39:03.024874 dv-cinder-zed-3-smb devstack@n-api.service[112029]: X-Openstack-Nova-Api-Version: 2.92 Oct 28 09:39:03.024874 dv-cinder-zed-3-smb devstack@n-api.service[112029]: X-Project-Domain-Id: default Oct 28 09:39:03.024874 dv-cinder-zed-3-smb devstack@n-api.service[112029]: X-Project-Domain-Name: Default Oct 28 09:39:03.024874 dv-cinder-zed-3-smb devstack@n-api.service[112029]: X-Project-Id: afd3325807f94fa3b6a7d418f71aaa51 Oct 28 09:39:03.024874 dv-cinder-zed-3-smb devstack@n-api.service[112029]: X-Project-Name: admin Oct 28 09:39:03.024874 dv-cinder-zed-3-smb devstack@n-api.service[112029]: X-Role: admin,reader,member Oct 28 09:39:03.024874 dv-cinder-zed-3-smb devstack@n-api.service[112029]: X-Roles: admin,reader,member Oct 28 09:39:03.026509 dv-cinder-zed-3-smb devstack@n-api.service[112029]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_afd3325807f94fa3b6a7d418f71aaa51"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/afd3325807f94fa3b6a7d418f71aaa51"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/afd3325807f94fa3b6a7d418f71aaa51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/afd3325807f94fa3b6a7d418f71aaa51"}]}] Oct 28 09:39:03.026509 dv-cinder-zed-3-smb devstack@n-api.service[112029]: X-Tenant: admin Oct 28 09:39:03.026509 dv-cinder-zed-3-smb devstack@n-api.service[112029]: X-Tenant-Id: afd3325807f94fa3b6a7d418f71aaa51 Oct 28 09:39:03.026509 dv-cinder-zed-3-smb devstack@n-api.service[112029]: X-Tenant-Name: admin Oct 28 09:39:03.026509 dv-cinder-zed-3-smb devstack@n-api.service[112029]: X-User: admin Oct 28 09:39:03.026509 dv-cinder-zed-3-smb devstack@n-api.service[112029]: X-User-Domain-Id: default Oct 28 09:39:03.026509 dv-cinder-zed-3-smb devstack@n-api.service[112029]: X-User-Domain-Name: Default Oct 28 09:39:03.026509 dv-cinder-zed-3-smb devstack@n-api.service[112029]: X-User-Id: 66bbceeaa7394d2b922231b2c11b4f8f Oct 28 09:39:03.026509 dv-cinder-zed-3-smb devstack@n-api.service[112029]: X-User-Name: admin Oct 28 09:39:03.026509 dv-cinder-zed-3-smb devstack@n-api.service[112029]: method: > Oct 28 09:39:03.026509 dv-cinder-zed-3-smb devstack@n-api.service[112029]: exception: Flavor 42 could not be found. Oct 28 09:39:03.026509 dv-cinder-zed-3-smb devstack@n-api.service[112029]: action_args: {'id': '42'} Oct 28 09:39:03.026509 dv-cinder-zed-3-smb devstack@n-api.service[112029]: {{(pid=112029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:39:03.026509 dv-cinder-zed-3-smb devstack@n-api.service[112029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:39:03.028434 dv-cinder-zed-3-smb devstack@n-api.service[112029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 28 09:39:03.028434 dv-cinder-zed-3-smb devstack@n-api.service[112029]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 28 09:39:03.028434 dv-cinder-zed-3-smb devstack@n-api.service[112029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 28 09:39:03.028434 dv-cinder-zed-3-smb devstack@n-api.service[112029]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 28 09:39:03.028434 dv-cinder-zed-3-smb devstack@n-api.service[112029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 09:39:03.028434 dv-cinder-zed-3-smb devstack@n-api.service[112029]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 09:39:03.028434 dv-cinder-zed-3-smb devstack@n-api.service[112029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 28 09:39:03.028434 dv-cinder-zed-3-smb devstack@n-api.service[112029]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 28 09:39:03.028434 dv-cinder-zed-3-smb devstack@n-api.service[112029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 28 09:39:03.028434 dv-cinder-zed-3-smb devstack@n-api.service[112029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:39:03.028434 dv-cinder-zed-3-smb devstack@n-api.service[112029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 28 09:39:03.028434 dv-cinder-zed-3-smb devstack@n-api.service[112029]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 28 09:39:03.028434 dv-cinder-zed-3-smb devstack@n-api.service[112029]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 28 09:39:03.028434 dv-cinder-zed-3-smb devstack@n-api.service[112029]: ERROR nova.api.openstack.wsgi Oct 28 09:39:03.028434 dv-cinder-zed-3-smb devstack@n-api.service[112029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:39:03.028434 dv-cinder-zed-3-smb devstack@n-api.service[112029]: ERROR nova.api.openstack.wsgi Oct 28 09:39:03.028434 dv-cinder-zed-3-smb devstack@n-api.service[112029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:39:03.028434 dv-cinder-zed-3-smb devstack@n-api.service[112029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:39:03.028434 dv-cinder-zed-3-smb devstack@n-api.service[112029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:39:03.029569 dv-cinder-zed-3-smb devstack@n-api.service[112029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:39:03.029569 dv-cinder-zed-3-smb devstack@n-api.service[112029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:39:03.029569 dv-cinder-zed-3-smb devstack@n-api.service[112029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:39:03.029569 dv-cinder-zed-3-smb devstack@n-api.service[112029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:39:03.029569 dv-cinder-zed-3-smb devstack@n-api.service[112029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 28 09:39:03.029569 dv-cinder-zed-3-smb devstack@n-api.service[112029]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 28 09:39:03.029569 dv-cinder-zed-3-smb devstack@n-api.service[112029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 28 09:39:03.029569 dv-cinder-zed-3-smb devstack@n-api.service[112029]: ERROR nova.api.openstack.wsgi Oct 28 09:39:03.029569 dv-cinder-zed-3-smb devstack@n-api.service[112029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:39:03.029569 dv-cinder-zed-3-smb devstack@n-api.service[112029]: ERROR nova.api.openstack.wsgi Oct 28 09:39:03.029569 dv-cinder-zed-3-smb devstack@n-api.service[112029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:39:03.029569 dv-cinder-zed-3-smb devstack@n-api.service[112029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:39:03.029569 dv-cinder-zed-3-smb devstack@n-api.service[112029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:39:03.029569 dv-cinder-zed-3-smb devstack@n-api.service[112029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:39:03.029569 dv-cinder-zed-3-smb devstack@n-api.service[112029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:39:03.029569 dv-cinder-zed-3-smb devstack@n-api.service[112029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 28 09:39:03.029569 dv-cinder-zed-3-smb devstack@n-api.service[112029]: ERROR nova.api.openstack.wsgi Oct 28 09:39:03.029569 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi [None req-a8be78c4-d1d8-417d-b847-e50d839dcab3 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=112029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:39:03.030626 dv-cinder-zed-3-smb devstack@n-api.service[112029]: INFO nova.api.openstack.requestlog [None req-a8be78c4-d1d8-417d-b847-e50d839dcab3 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.586720 Oct 28 09:39:03.030626 dv-cinder-zed-3-smb devstack@n-api.service[112029]: [pid: 112029|app: 0|req: 19/39] 10.222.0.52 () {60 vars in 1190 bytes} [Fri Oct 28 09:39:02 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 588 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 28 09:39:03.040627 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi [None req-1dd5871e-f674-4e01-a061-aa9368ff4626 admin admin] Calling method '>' {{(pid=112028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:39:03.045105 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG dbcounter [-] [112028] Writing DB stats nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:INSERT=2,nova_api:RELEASE=1 {{(pid=112028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:39:03.066569 dv-cinder-zed-3-smb devstack@n-api.service[112028]: INFO nova.api.openstack.requestlog [None req-1dd5871e-f674-4e01-a061-aa9368ff4626 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.033116 Oct 28 09:39:03.067332 dv-cinder-zed-3-smb devstack@n-api.service[112028]: [pid: 112028|app: 0|req: 21/40] 10.222.0.52 () {60 vars in 1210 bytes} [Fri Oct 28 09:39:03 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:39:03.078968 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi [None req-ad6e6da2-c164-455c-a2eb-08bac661a232 admin admin] Calling method '>' {{(pid=112029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:39:03.102191 dv-cinder-zed-3-smb devstack@n-api.service[112029]: INFO nova.api.openstack.requestlog [None req-ad6e6da2-c164-455c-a2eb-08bac661a232 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.028350 Oct 28 09:39:03.102766 dv-cinder-zed-3-smb devstack@n-api.service[112029]: [pid: 112029|app: 0|req: 20/41] 10.222.0.52 () {60 vars in 1210 bytes} [Fri Oct 28 09:39:03 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:39:03.112348 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi [None req-5a20e8fb-1bbc-48f2-a707-d2079bed13e0 admin admin] Calling method '>' {{(pid=112028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:39:03.120638 dv-cinder-zed-3-smb devstack@n-api.service[112028]: INFO nova.api.openstack.wsgi [None req-5a20e8fb-1bbc-48f2-a707-d2079bed13e0 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 28 09:39:03.124033 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi [None req-5a20e8fb-1bbc-48f2-a707-d2079bed13e0 admin admin] Request method failure captured: Oct 28 09:39:03.124033 dv-cinder-zed-3-smb devstack@n-api.service[112028]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 28 09:39:03.124033 dv-cinder-zed-3-smb devstack@n-api.service[112028]: Accept: application/json Oct 28 09:39:03.124033 dv-cinder-zed-3-smb devstack@n-api.service[112028]: Accept-Encoding: gzip, deflate Oct 28 09:39:03.124033 dv-cinder-zed-3-smb devstack@n-api.service[112028]: Connection: keep-alive Oct 28 09:39:03.124033 dv-cinder-zed-3-smb devstack@n-api.service[112028]: Content-Length: 0 Oct 28 09:39:03.124033 dv-cinder-zed-3-smb devstack@n-api.service[112028]: Host: 10.222.0.52 Oct 28 09:39:03.124033 dv-cinder-zed-3-smb devstack@n-api.service[112028]: Openstack-Api-Version: compute 2.92 Oct 28 09:39:03.124033 dv-cinder-zed-3-smb devstack@n-api.service[112028]: Openstack-System-Scope: None Oct 28 09:39:03.124033 dv-cinder-zed-3-smb devstack@n-api.service[112028]: User-Agent: python-novaclient Oct 28 09:39:03.124033 dv-cinder-zed-3-smb devstack@n-api.service[112028]: X-Auth-Token: gAAAAABjW6M2yKGblseww104x3gt6c1Vy47zDRyQFc3iHvxZhyp5qLYBIEdKOdbqNwyFYQXv-1Rn0kUUt0d9FJxIg_Z6DnQu5Rna0yoXbe0hO5Ppn1DvHaj6zUY9C74RzDD2SSQxyM2X3T52ZRWd7khCcQK1e49Rz-Vh6vn_37C_pnq5Pw7wyfw Oct 28 09:39:03.124033 dv-cinder-zed-3-smb devstack@n-api.service[112028]: X-Domain-Id: None Oct 28 09:39:03.124033 dv-cinder-zed-3-smb devstack@n-api.service[112028]: X-Domain-Name: None Oct 28 09:39:03.124033 dv-cinder-zed-3-smb devstack@n-api.service[112028]: X-Identity-Status: Confirmed Oct 28 09:39:03.124033 dv-cinder-zed-3-smb devstack@n-api.service[112028]: X-Is-Admin-Project: True Oct 28 09:39:03.124033 dv-cinder-zed-3-smb devstack@n-api.service[112028]: X-Openstack-Nova-Api-Version: 2.92 Oct 28 09:39:03.124033 dv-cinder-zed-3-smb devstack@n-api.service[112028]: X-Project-Domain-Id: default Oct 28 09:39:03.124033 dv-cinder-zed-3-smb devstack@n-api.service[112028]: X-Project-Domain-Name: Default Oct 28 09:39:03.124033 dv-cinder-zed-3-smb devstack@n-api.service[112028]: X-Project-Id: afd3325807f94fa3b6a7d418f71aaa51 Oct 28 09:39:03.124033 dv-cinder-zed-3-smb devstack@n-api.service[112028]: X-Project-Name: admin Oct 28 09:39:03.124033 dv-cinder-zed-3-smb devstack@n-api.service[112028]: X-Role: admin,reader,member Oct 28 09:39:03.124033 dv-cinder-zed-3-smb devstack@n-api.service[112028]: X-Roles: admin,reader,member Oct 28 09:39:03.126497 dv-cinder-zed-3-smb devstack@n-api.service[112028]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_afd3325807f94fa3b6a7d418f71aaa51"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/afd3325807f94fa3b6a7d418f71aaa51"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/afd3325807f94fa3b6a7d418f71aaa51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/afd3325807f94fa3b6a7d418f71aaa51"}]}] Oct 28 09:39:03.126497 dv-cinder-zed-3-smb devstack@n-api.service[112028]: X-Tenant: admin Oct 28 09:39:03.126497 dv-cinder-zed-3-smb devstack@n-api.service[112028]: X-Tenant-Id: afd3325807f94fa3b6a7d418f71aaa51 Oct 28 09:39:03.126497 dv-cinder-zed-3-smb devstack@n-api.service[112028]: X-Tenant-Name: admin Oct 28 09:39:03.126497 dv-cinder-zed-3-smb devstack@n-api.service[112028]: X-User: admin Oct 28 09:39:03.126497 dv-cinder-zed-3-smb devstack@n-api.service[112028]: X-User-Domain-Id: default Oct 28 09:39:03.126497 dv-cinder-zed-3-smb devstack@n-api.service[112028]: X-User-Domain-Name: Default Oct 28 09:39:03.126497 dv-cinder-zed-3-smb devstack@n-api.service[112028]: X-User-Id: 66bbceeaa7394d2b922231b2c11b4f8f Oct 28 09:39:03.126497 dv-cinder-zed-3-smb devstack@n-api.service[112028]: X-User-Name: admin Oct 28 09:39:03.126497 dv-cinder-zed-3-smb devstack@n-api.service[112028]: method: > Oct 28 09:39:03.126497 dv-cinder-zed-3-smb devstack@n-api.service[112028]: exception: Flavor 42 could not be found. Oct 28 09:39:03.126497 dv-cinder-zed-3-smb devstack@n-api.service[112028]: action_args: {'id': '42'} Oct 28 09:39:03.126497 dv-cinder-zed-3-smb devstack@n-api.service[112028]: {{(pid=112028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:39:03.126497 dv-cinder-zed-3-smb devstack@n-api.service[112028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:39:03.127572 dv-cinder-zed-3-smb devstack@n-api.service[112028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 28 09:39:03.127572 dv-cinder-zed-3-smb devstack@n-api.service[112028]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 28 09:39:03.127572 dv-cinder-zed-3-smb devstack@n-api.service[112028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 28 09:39:03.127572 dv-cinder-zed-3-smb devstack@n-api.service[112028]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 28 09:39:03.127572 dv-cinder-zed-3-smb devstack@n-api.service[112028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 09:39:03.127572 dv-cinder-zed-3-smb devstack@n-api.service[112028]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 09:39:03.127572 dv-cinder-zed-3-smb devstack@n-api.service[112028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 28 09:39:03.127572 dv-cinder-zed-3-smb devstack@n-api.service[112028]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 28 09:39:03.127572 dv-cinder-zed-3-smb devstack@n-api.service[112028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 28 09:39:03.127572 dv-cinder-zed-3-smb devstack@n-api.service[112028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:39:03.127572 dv-cinder-zed-3-smb devstack@n-api.service[112028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 28 09:39:03.127572 dv-cinder-zed-3-smb devstack@n-api.service[112028]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 28 09:39:03.127572 dv-cinder-zed-3-smb devstack@n-api.service[112028]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 28 09:39:03.127572 dv-cinder-zed-3-smb devstack@n-api.service[112028]: ERROR nova.api.openstack.wsgi Oct 28 09:39:03.127572 dv-cinder-zed-3-smb devstack@n-api.service[112028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:39:03.127572 dv-cinder-zed-3-smb devstack@n-api.service[112028]: ERROR nova.api.openstack.wsgi Oct 28 09:39:03.127572 dv-cinder-zed-3-smb devstack@n-api.service[112028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:39:03.127572 dv-cinder-zed-3-smb devstack@n-api.service[112028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:39:03.127572 dv-cinder-zed-3-smb devstack@n-api.service[112028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:39:03.128922 dv-cinder-zed-3-smb devstack@n-api.service[112028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:39:03.128922 dv-cinder-zed-3-smb devstack@n-api.service[112028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:39:03.128922 dv-cinder-zed-3-smb devstack@n-api.service[112028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:39:03.128922 dv-cinder-zed-3-smb devstack@n-api.service[112028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:39:03.128922 dv-cinder-zed-3-smb devstack@n-api.service[112028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 28 09:39:03.128922 dv-cinder-zed-3-smb devstack@n-api.service[112028]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 28 09:39:03.128922 dv-cinder-zed-3-smb devstack@n-api.service[112028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 28 09:39:03.128922 dv-cinder-zed-3-smb devstack@n-api.service[112028]: ERROR nova.api.openstack.wsgi Oct 28 09:39:03.128922 dv-cinder-zed-3-smb devstack@n-api.service[112028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:39:03.128922 dv-cinder-zed-3-smb devstack@n-api.service[112028]: ERROR nova.api.openstack.wsgi Oct 28 09:39:03.128922 dv-cinder-zed-3-smb devstack@n-api.service[112028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:39:03.128922 dv-cinder-zed-3-smb devstack@n-api.service[112028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:39:03.128922 dv-cinder-zed-3-smb devstack@n-api.service[112028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:39:03.128922 dv-cinder-zed-3-smb devstack@n-api.service[112028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:39:03.128922 dv-cinder-zed-3-smb devstack@n-api.service[112028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:39:03.128922 dv-cinder-zed-3-smb devstack@n-api.service[112028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 28 09:39:03.128922 dv-cinder-zed-3-smb devstack@n-api.service[112028]: ERROR nova.api.openstack.wsgi Oct 28 09:39:03.128922 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi [None req-5a20e8fb-1bbc-48f2-a707-d2079bed13e0 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=112028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:39:03.130297 dv-cinder-zed-3-smb devstack@n-api.service[112028]: INFO nova.api.openstack.requestlog [None req-5a20e8fb-1bbc-48f2-a707-d2079bed13e0 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.016720 Oct 28 09:39:03.130297 dv-cinder-zed-3-smb devstack@n-api.service[112028]: [pid: 112028|app: 0|req: 22/42] 10.222.0.52 () {60 vars in 1190 bytes} [Fri Oct 28 09:39:03 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 28 09:39:04.370343 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi [None req-ad6e6da2-c164-455c-a2eb-08bac661a232 admin admin] Calling method '>' {{(pid=112029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:39:04.371351 dv-cinder-zed-3-smb devstack@n-api.service[112029]: INFO nova.api.openstack.requestlog [None req-ad6e6da2-c164-455c-a2eb-08bac661a232 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Oct 28 09:39:04.371853 dv-cinder-zed-3-smb devstack@n-api.service[112029]: [pid: 112029|app: 0|req: 21/43] 10.222.0.52 () {56 vars in 1074 bytes} [Fri Oct 28 09:39:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:39:04.943452 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi [None req-904988d8-15a4-46bf-973f-a8beaa9fc79e admin admin] Calling method '>' {{(pid=112028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:39:04.949052 dv-cinder-zed-3-smb devstack@n-api.service[112028]: INFO nova.api.openstack.wsgi [None req-904988d8-15a4-46bf-973f-a8beaa9fc79e admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 28 09:39:04.950616 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi [None req-904988d8-15a4-46bf-973f-a8beaa9fc79e admin admin] Request method failure captured: Oct 28 09:39:04.950616 dv-cinder-zed-3-smb devstack@n-api.service[112028]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 28 09:39:04.950616 dv-cinder-zed-3-smb devstack@n-api.service[112028]: Accept: application/json Oct 28 09:39:04.950616 dv-cinder-zed-3-smb devstack@n-api.service[112028]: Accept-Encoding: gzip, deflate Oct 28 09:39:04.950616 dv-cinder-zed-3-smb devstack@n-api.service[112028]: Connection: keep-alive Oct 28 09:39:04.950616 dv-cinder-zed-3-smb devstack@n-api.service[112028]: Content-Length: 0 Oct 28 09:39:04.950616 dv-cinder-zed-3-smb devstack@n-api.service[112028]: Host: 10.222.0.52 Oct 28 09:39:04.950616 dv-cinder-zed-3-smb devstack@n-api.service[112028]: Openstack-Api-Version: compute 2.92 Oct 28 09:39:04.950616 dv-cinder-zed-3-smb devstack@n-api.service[112028]: Openstack-System-Scope: None Oct 28 09:39:04.950616 dv-cinder-zed-3-smb devstack@n-api.service[112028]: User-Agent: python-novaclient Oct 28 09:39:04.950616 dv-cinder-zed-3-smb devstack@n-api.service[112028]: X-Auth-Token: gAAAAABjW6M44sYu5mXwbe7L06Ax79AHOfIMT1bfPoUeTuznNjyfMcB1Z887yzdNwlITA_uPiJx3Fp7e_qzzS0rlfOcbgXbOFeB1uKI7ND4SoMoekFfufdUKII-6rEqymC50MXfAkIwidPL3iyvpVisRj4Vf-UpfoHgm_TYzbj4Z8aywyKr1GmQ Oct 28 09:39:04.950616 dv-cinder-zed-3-smb devstack@n-api.service[112028]: X-Domain-Id: None Oct 28 09:39:04.950616 dv-cinder-zed-3-smb devstack@n-api.service[112028]: X-Domain-Name: None Oct 28 09:39:04.950616 dv-cinder-zed-3-smb devstack@n-api.service[112028]: X-Identity-Status: Confirmed Oct 28 09:39:04.950616 dv-cinder-zed-3-smb devstack@n-api.service[112028]: X-Is-Admin-Project: True Oct 28 09:39:04.950616 dv-cinder-zed-3-smb devstack@n-api.service[112028]: X-Openstack-Nova-Api-Version: 2.92 Oct 28 09:39:04.950616 dv-cinder-zed-3-smb devstack@n-api.service[112028]: X-Project-Domain-Id: default Oct 28 09:39:04.950616 dv-cinder-zed-3-smb devstack@n-api.service[112028]: X-Project-Domain-Name: Default Oct 28 09:39:04.950616 dv-cinder-zed-3-smb devstack@n-api.service[112028]: X-Project-Id: afd3325807f94fa3b6a7d418f71aaa51 Oct 28 09:39:04.950616 dv-cinder-zed-3-smb devstack@n-api.service[112028]: X-Project-Name: admin Oct 28 09:39:04.950616 dv-cinder-zed-3-smb devstack@n-api.service[112028]: X-Role: admin,reader,member Oct 28 09:39:04.950616 dv-cinder-zed-3-smb devstack@n-api.service[112028]: X-Roles: admin,reader,member Oct 28 09:39:04.952612 dv-cinder-zed-3-smb devstack@n-api.service[112028]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_afd3325807f94fa3b6a7d418f71aaa51"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/afd3325807f94fa3b6a7d418f71aaa51"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/afd3325807f94fa3b6a7d418f71aaa51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/afd3325807f94fa3b6a7d418f71aaa51"}]}] Oct 28 09:39:04.952612 dv-cinder-zed-3-smb devstack@n-api.service[112028]: X-Tenant: admin Oct 28 09:39:04.952612 dv-cinder-zed-3-smb devstack@n-api.service[112028]: X-Tenant-Id: afd3325807f94fa3b6a7d418f71aaa51 Oct 28 09:39:04.952612 dv-cinder-zed-3-smb devstack@n-api.service[112028]: X-Tenant-Name: admin Oct 28 09:39:04.952612 dv-cinder-zed-3-smb devstack@n-api.service[112028]: X-User: admin Oct 28 09:39:04.952612 dv-cinder-zed-3-smb devstack@n-api.service[112028]: X-User-Domain-Id: default Oct 28 09:39:04.952612 dv-cinder-zed-3-smb devstack@n-api.service[112028]: X-User-Domain-Name: Default Oct 28 09:39:04.952612 dv-cinder-zed-3-smb devstack@n-api.service[112028]: X-User-Id: 66bbceeaa7394d2b922231b2c11b4f8f Oct 28 09:39:04.952612 dv-cinder-zed-3-smb devstack@n-api.service[112028]: X-User-Name: admin Oct 28 09:39:04.952612 dv-cinder-zed-3-smb devstack@n-api.service[112028]: method: > Oct 28 09:39:04.952612 dv-cinder-zed-3-smb devstack@n-api.service[112028]: exception: Flavor 84 could not be found. Oct 28 09:39:04.952612 dv-cinder-zed-3-smb devstack@n-api.service[112028]: action_args: {'id': '84'} Oct 28 09:39:04.952612 dv-cinder-zed-3-smb devstack@n-api.service[112028]: {{(pid=112028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:39:04.952612 dv-cinder-zed-3-smb devstack@n-api.service[112028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:39:04.953660 dv-cinder-zed-3-smb devstack@n-api.service[112028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 28 09:39:04.953660 dv-cinder-zed-3-smb devstack@n-api.service[112028]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 28 09:39:04.953660 dv-cinder-zed-3-smb devstack@n-api.service[112028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 28 09:39:04.953660 dv-cinder-zed-3-smb devstack@n-api.service[112028]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 28 09:39:04.953660 dv-cinder-zed-3-smb devstack@n-api.service[112028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 09:39:04.953660 dv-cinder-zed-3-smb devstack@n-api.service[112028]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 09:39:04.953660 dv-cinder-zed-3-smb devstack@n-api.service[112028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 28 09:39:04.953660 dv-cinder-zed-3-smb devstack@n-api.service[112028]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 28 09:39:04.953660 dv-cinder-zed-3-smb devstack@n-api.service[112028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 28 09:39:04.953660 dv-cinder-zed-3-smb devstack@n-api.service[112028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:39:04.953660 dv-cinder-zed-3-smb devstack@n-api.service[112028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 28 09:39:04.953660 dv-cinder-zed-3-smb devstack@n-api.service[112028]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 28 09:39:04.953660 dv-cinder-zed-3-smb devstack@n-api.service[112028]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 28 09:39:04.953660 dv-cinder-zed-3-smb devstack@n-api.service[112028]: ERROR nova.api.openstack.wsgi Oct 28 09:39:04.953660 dv-cinder-zed-3-smb devstack@n-api.service[112028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:39:04.953660 dv-cinder-zed-3-smb devstack@n-api.service[112028]: ERROR nova.api.openstack.wsgi Oct 28 09:39:04.953660 dv-cinder-zed-3-smb devstack@n-api.service[112028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:39:04.953660 dv-cinder-zed-3-smb devstack@n-api.service[112028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:39:04.953660 dv-cinder-zed-3-smb devstack@n-api.service[112028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:39:04.955029 dv-cinder-zed-3-smb devstack@n-api.service[112028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:39:04.955029 dv-cinder-zed-3-smb devstack@n-api.service[112028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:39:04.955029 dv-cinder-zed-3-smb devstack@n-api.service[112028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:39:04.955029 dv-cinder-zed-3-smb devstack@n-api.service[112028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:39:04.955029 dv-cinder-zed-3-smb devstack@n-api.service[112028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 28 09:39:04.955029 dv-cinder-zed-3-smb devstack@n-api.service[112028]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 28 09:39:04.955029 dv-cinder-zed-3-smb devstack@n-api.service[112028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 28 09:39:04.955029 dv-cinder-zed-3-smb devstack@n-api.service[112028]: ERROR nova.api.openstack.wsgi Oct 28 09:39:04.955029 dv-cinder-zed-3-smb devstack@n-api.service[112028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:39:04.955029 dv-cinder-zed-3-smb devstack@n-api.service[112028]: ERROR nova.api.openstack.wsgi Oct 28 09:39:04.955029 dv-cinder-zed-3-smb devstack@n-api.service[112028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:39:04.955029 dv-cinder-zed-3-smb devstack@n-api.service[112028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:39:04.955029 dv-cinder-zed-3-smb devstack@n-api.service[112028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:39:04.955029 dv-cinder-zed-3-smb devstack@n-api.service[112028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:39:04.955029 dv-cinder-zed-3-smb devstack@n-api.service[112028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:39:04.955029 dv-cinder-zed-3-smb devstack@n-api.service[112028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 28 09:39:04.955029 dv-cinder-zed-3-smb devstack@n-api.service[112028]: ERROR nova.api.openstack.wsgi Oct 28 09:39:04.955029 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi [None req-904988d8-15a4-46bf-973f-a8beaa9fc79e admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=112028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:39:04.956983 dv-cinder-zed-3-smb devstack@n-api.service[112028]: INFO nova.api.openstack.requestlog [None req-904988d8-15a4-46bf-973f-a8beaa9fc79e admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.439644 Oct 28 09:39:04.956983 dv-cinder-zed-3-smb devstack@n-api.service[112028]: [pid: 112028|app: 0|req: 23/44] 10.222.0.52 () {60 vars in 1190 bytes} [Fri Oct 28 09:39:04 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 441 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 28 09:39:04.963114 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi [None req-4e3c74b7-0fe2-46f1-a2f8-17c579201530 admin admin] Calling method '>' {{(pid=112029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:39:04.980094 dv-cinder-zed-3-smb devstack@n-api.service[112029]: INFO nova.api.openstack.requestlog [None req-4e3c74b7-0fe2-46f1-a2f8-17c579201530 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.020591 Oct 28 09:39:04.980672 dv-cinder-zed-3-smb devstack@n-api.service[112029]: [pid: 112029|app: 0|req: 22/45] 10.222.0.52 () {60 vars in 1210 bytes} [Fri Oct 28 09:39:04 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:39:04.990982 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi [None req-8c7a4091-2c1a-46ae-9997-8e43af8c0ec6 admin admin] Calling method '>' {{(pid=112028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:39:05.007162 dv-cinder-zed-3-smb devstack@n-api.service[112028]: INFO nova.api.openstack.requestlog [None req-8c7a4091-2c1a-46ae-9997-8e43af8c0ec6 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019936 Oct 28 09:39:05.007826 dv-cinder-zed-3-smb devstack@n-api.service[112028]: [pid: 112028|app: 0|req: 24/46] 10.222.0.52 () {60 vars in 1210 bytes} [Fri Oct 28 09:39:04 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:39:05.017990 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi [None req-b1a7b5dd-f487-41ce-8842-eb1bf50b3c36 admin admin] Calling method '>' {{(pid=112029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:39:05.025179 dv-cinder-zed-3-smb devstack@n-api.service[112029]: INFO nova.api.openstack.wsgi [None req-b1a7b5dd-f487-41ce-8842-eb1bf50b3c36 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 28 09:39:05.026763 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi [None req-b1a7b5dd-f487-41ce-8842-eb1bf50b3c36 admin admin] Request method failure captured: Oct 28 09:39:05.026763 dv-cinder-zed-3-smb devstack@n-api.service[112029]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 28 09:39:05.026763 dv-cinder-zed-3-smb devstack@n-api.service[112029]: Accept: application/json Oct 28 09:39:05.026763 dv-cinder-zed-3-smb devstack@n-api.service[112029]: Accept-Encoding: gzip, deflate Oct 28 09:39:05.026763 dv-cinder-zed-3-smb devstack@n-api.service[112029]: Connection: keep-alive Oct 28 09:39:05.026763 dv-cinder-zed-3-smb devstack@n-api.service[112029]: Content-Length: 0 Oct 28 09:39:05.026763 dv-cinder-zed-3-smb devstack@n-api.service[112029]: Host: 10.222.0.52 Oct 28 09:39:05.026763 dv-cinder-zed-3-smb devstack@n-api.service[112029]: Openstack-Api-Version: compute 2.92 Oct 28 09:39:05.026763 dv-cinder-zed-3-smb devstack@n-api.service[112029]: Openstack-System-Scope: None Oct 28 09:39:05.026763 dv-cinder-zed-3-smb devstack@n-api.service[112029]: User-Agent: python-novaclient Oct 28 09:39:05.026763 dv-cinder-zed-3-smb devstack@n-api.service[112029]: X-Auth-Token: gAAAAABjW6M44sYu5mXwbe7L06Ax79AHOfIMT1bfPoUeTuznNjyfMcB1Z887yzdNwlITA_uPiJx3Fp7e_qzzS0rlfOcbgXbOFeB1uKI7ND4SoMoekFfufdUKII-6rEqymC50MXfAkIwidPL3iyvpVisRj4Vf-UpfoHgm_TYzbj4Z8aywyKr1GmQ Oct 28 09:39:05.026763 dv-cinder-zed-3-smb devstack@n-api.service[112029]: X-Domain-Id: None Oct 28 09:39:05.026763 dv-cinder-zed-3-smb devstack@n-api.service[112029]: X-Domain-Name: None Oct 28 09:39:05.026763 dv-cinder-zed-3-smb devstack@n-api.service[112029]: X-Identity-Status: Confirmed Oct 28 09:39:05.026763 dv-cinder-zed-3-smb devstack@n-api.service[112029]: X-Is-Admin-Project: True Oct 28 09:39:05.026763 dv-cinder-zed-3-smb devstack@n-api.service[112029]: X-Openstack-Nova-Api-Version: 2.92 Oct 28 09:39:05.026763 dv-cinder-zed-3-smb devstack@n-api.service[112029]: X-Project-Domain-Id: default Oct 28 09:39:05.026763 dv-cinder-zed-3-smb devstack@n-api.service[112029]: X-Project-Domain-Name: Default Oct 28 09:39:05.026763 dv-cinder-zed-3-smb devstack@n-api.service[112029]: X-Project-Id: afd3325807f94fa3b6a7d418f71aaa51 Oct 28 09:39:05.026763 dv-cinder-zed-3-smb devstack@n-api.service[112029]: X-Project-Name: admin Oct 28 09:39:05.026763 dv-cinder-zed-3-smb devstack@n-api.service[112029]: X-Role: admin,reader,member Oct 28 09:39:05.026763 dv-cinder-zed-3-smb devstack@n-api.service[112029]: X-Roles: admin,reader,member Oct 28 09:39:05.028304 dv-cinder-zed-3-smb devstack@n-api.service[112029]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_afd3325807f94fa3b6a7d418f71aaa51"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/afd3325807f94fa3b6a7d418f71aaa51"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/afd3325807f94fa3b6a7d418f71aaa51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/afd3325807f94fa3b6a7d418f71aaa51"}]}] Oct 28 09:39:05.028304 dv-cinder-zed-3-smb devstack@n-api.service[112029]: X-Tenant: admin Oct 28 09:39:05.028304 dv-cinder-zed-3-smb devstack@n-api.service[112029]: X-Tenant-Id: afd3325807f94fa3b6a7d418f71aaa51 Oct 28 09:39:05.028304 dv-cinder-zed-3-smb devstack@n-api.service[112029]: X-Tenant-Name: admin Oct 28 09:39:05.028304 dv-cinder-zed-3-smb devstack@n-api.service[112029]: X-User: admin Oct 28 09:39:05.028304 dv-cinder-zed-3-smb devstack@n-api.service[112029]: X-User-Domain-Id: default Oct 28 09:39:05.028304 dv-cinder-zed-3-smb devstack@n-api.service[112029]: X-User-Domain-Name: Default Oct 28 09:39:05.028304 dv-cinder-zed-3-smb devstack@n-api.service[112029]: X-User-Id: 66bbceeaa7394d2b922231b2c11b4f8f Oct 28 09:39:05.028304 dv-cinder-zed-3-smb devstack@n-api.service[112029]: X-User-Name: admin Oct 28 09:39:05.028304 dv-cinder-zed-3-smb devstack@n-api.service[112029]: method: > Oct 28 09:39:05.028304 dv-cinder-zed-3-smb devstack@n-api.service[112029]: exception: Flavor 84 could not be found. Oct 28 09:39:05.028304 dv-cinder-zed-3-smb devstack@n-api.service[112029]: action_args: {'id': '84'} Oct 28 09:39:05.028304 dv-cinder-zed-3-smb devstack@n-api.service[112029]: {{(pid=112029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:39:05.028304 dv-cinder-zed-3-smb devstack@n-api.service[112029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:39:05.029186 dv-cinder-zed-3-smb devstack@n-api.service[112029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 28 09:39:05.029186 dv-cinder-zed-3-smb devstack@n-api.service[112029]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 28 09:39:05.029186 dv-cinder-zed-3-smb devstack@n-api.service[112029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 28 09:39:05.029186 dv-cinder-zed-3-smb devstack@n-api.service[112029]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 28 09:39:05.029186 dv-cinder-zed-3-smb devstack@n-api.service[112029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 09:39:05.029186 dv-cinder-zed-3-smb devstack@n-api.service[112029]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 09:39:05.029186 dv-cinder-zed-3-smb devstack@n-api.service[112029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 28 09:39:05.029186 dv-cinder-zed-3-smb devstack@n-api.service[112029]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 28 09:39:05.029186 dv-cinder-zed-3-smb devstack@n-api.service[112029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 28 09:39:05.029186 dv-cinder-zed-3-smb devstack@n-api.service[112029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:39:05.029186 dv-cinder-zed-3-smb devstack@n-api.service[112029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 28 09:39:05.029186 dv-cinder-zed-3-smb devstack@n-api.service[112029]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 28 09:39:05.029186 dv-cinder-zed-3-smb devstack@n-api.service[112029]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 28 09:39:05.029186 dv-cinder-zed-3-smb devstack@n-api.service[112029]: ERROR nova.api.openstack.wsgi Oct 28 09:39:05.029186 dv-cinder-zed-3-smb devstack@n-api.service[112029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:39:05.029186 dv-cinder-zed-3-smb devstack@n-api.service[112029]: ERROR nova.api.openstack.wsgi Oct 28 09:39:05.029186 dv-cinder-zed-3-smb devstack@n-api.service[112029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:39:05.029186 dv-cinder-zed-3-smb devstack@n-api.service[112029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:39:05.029186 dv-cinder-zed-3-smb devstack@n-api.service[112029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:39:05.030476 dv-cinder-zed-3-smb devstack@n-api.service[112029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:39:05.030476 dv-cinder-zed-3-smb devstack@n-api.service[112029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:39:05.030476 dv-cinder-zed-3-smb devstack@n-api.service[112029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:39:05.030476 dv-cinder-zed-3-smb devstack@n-api.service[112029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:39:05.030476 dv-cinder-zed-3-smb devstack@n-api.service[112029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 28 09:39:05.030476 dv-cinder-zed-3-smb devstack@n-api.service[112029]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 28 09:39:05.030476 dv-cinder-zed-3-smb devstack@n-api.service[112029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 28 09:39:05.030476 dv-cinder-zed-3-smb devstack@n-api.service[112029]: ERROR nova.api.openstack.wsgi Oct 28 09:39:05.030476 dv-cinder-zed-3-smb devstack@n-api.service[112029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:39:05.030476 dv-cinder-zed-3-smb devstack@n-api.service[112029]: ERROR nova.api.openstack.wsgi Oct 28 09:39:05.030476 dv-cinder-zed-3-smb devstack@n-api.service[112029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:39:05.030476 dv-cinder-zed-3-smb devstack@n-api.service[112029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:39:05.030476 dv-cinder-zed-3-smb devstack@n-api.service[112029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:39:05.030476 dv-cinder-zed-3-smb devstack@n-api.service[112029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:39:05.030476 dv-cinder-zed-3-smb devstack@n-api.service[112029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:39:05.030476 dv-cinder-zed-3-smb devstack@n-api.service[112029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 28 09:39:05.030476 dv-cinder-zed-3-smb devstack@n-api.service[112029]: ERROR nova.api.openstack.wsgi Oct 28 09:39:05.030476 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi [None req-b1a7b5dd-f487-41ce-8842-eb1bf50b3c36 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=112029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:39:05.031707 dv-cinder-zed-3-smb devstack@n-api.service[112029]: INFO nova.api.openstack.requestlog [None req-b1a7b5dd-f487-41ce-8842-eb1bf50b3c36 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.013889 Oct 28 09:39:05.031707 dv-cinder-zed-3-smb devstack@n-api.service[112029]: [pid: 112029|app: 0|req: 23/47] 10.222.0.52 () {60 vars in 1190 bytes} [Fri Oct 28 09:39:05 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 28 09:39:06.280254 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi [None req-8c7a4091-2c1a-46ae-9997-8e43af8c0ec6 admin admin] Calling method '>' {{(pid=112028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:39:06.281262 dv-cinder-zed-3-smb devstack@n-api.service[112028]: INFO nova.api.openstack.requestlog [None req-8c7a4091-2c1a-46ae-9997-8e43af8c0ec6 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Oct 28 09:39:06.281662 dv-cinder-zed-3-smb devstack@n-api.service[112028]: [pid: 112028|app: 0|req: 25/48] 10.222.0.52 () {56 vars in 1074 bytes} [Fri Oct 28 09:39:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:39:06.842009 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi [None req-e38cca46-a6fd-4ca8-8b7a-9b966874eea2 admin admin] Calling method '>' {{(pid=112029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:39:06.848716 dv-cinder-zed-3-smb devstack@n-api.service[112029]: INFO nova.api.openstack.wsgi [None req-e38cca46-a6fd-4ca8-8b7a-9b966874eea2 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 28 09:39:06.850258 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi [None req-e38cca46-a6fd-4ca8-8b7a-9b966874eea2 admin admin] Request method failure captured: Oct 28 09:39:06.850258 dv-cinder-zed-3-smb devstack@n-api.service[112029]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 28 09:39:06.850258 dv-cinder-zed-3-smb devstack@n-api.service[112029]: Accept: application/json Oct 28 09:39:06.850258 dv-cinder-zed-3-smb devstack@n-api.service[112029]: Accept-Encoding: gzip, deflate Oct 28 09:39:06.850258 dv-cinder-zed-3-smb devstack@n-api.service[112029]: Connection: keep-alive Oct 28 09:39:06.850258 dv-cinder-zed-3-smb devstack@n-api.service[112029]: Content-Length: 0 Oct 28 09:39:06.850258 dv-cinder-zed-3-smb devstack@n-api.service[112029]: Host: 10.222.0.52 Oct 28 09:39:06.850258 dv-cinder-zed-3-smb devstack@n-api.service[112029]: Openstack-Api-Version: compute 2.92 Oct 28 09:39:06.850258 dv-cinder-zed-3-smb devstack@n-api.service[112029]: Openstack-System-Scope: None Oct 28 09:39:06.850258 dv-cinder-zed-3-smb devstack@n-api.service[112029]: User-Agent: python-novaclient Oct 28 09:39:06.850258 dv-cinder-zed-3-smb devstack@n-api.service[112029]: X-Auth-Token: gAAAAABjW6M6WzDlqKVmT4tkpjPZJG0IDlWs3Ol4pvh0UtiJ2Ww--vDPueQ3LTG2psKlLI2W_NGAPmxbhFYJSMPdEKC3HzdpKuzTemzHnEpZh5Im_SI4iCDiUHgFghpkCigAX1HksLVhPKRTQemtIJS59lBtJpq75WFZJY2-cCy8yYTE4NnmhKo Oct 28 09:39:06.850258 dv-cinder-zed-3-smb devstack@n-api.service[112029]: X-Domain-Id: None Oct 28 09:39:06.850258 dv-cinder-zed-3-smb devstack@n-api.service[112029]: X-Domain-Name: None Oct 28 09:39:06.850258 dv-cinder-zed-3-smb devstack@n-api.service[112029]: X-Identity-Status: Confirmed Oct 28 09:39:06.850258 dv-cinder-zed-3-smb devstack@n-api.service[112029]: X-Is-Admin-Project: True Oct 28 09:39:06.850258 dv-cinder-zed-3-smb devstack@n-api.service[112029]: X-Openstack-Nova-Api-Version: 2.92 Oct 28 09:39:06.850258 dv-cinder-zed-3-smb devstack@n-api.service[112029]: X-Project-Domain-Id: default Oct 28 09:39:06.850258 dv-cinder-zed-3-smb devstack@n-api.service[112029]: X-Project-Domain-Name: Default Oct 28 09:39:06.850258 dv-cinder-zed-3-smb devstack@n-api.service[112029]: X-Project-Id: afd3325807f94fa3b6a7d418f71aaa51 Oct 28 09:39:06.850258 dv-cinder-zed-3-smb devstack@n-api.service[112029]: X-Project-Name: admin Oct 28 09:39:06.850258 dv-cinder-zed-3-smb devstack@n-api.service[112029]: X-Role: admin,reader,member Oct 28 09:39:06.850258 dv-cinder-zed-3-smb devstack@n-api.service[112029]: X-Roles: admin,reader,member Oct 28 09:39:06.851797 dv-cinder-zed-3-smb devstack@n-api.service[112029]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_afd3325807f94fa3b6a7d418f71aaa51"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/afd3325807f94fa3b6a7d418f71aaa51"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/afd3325807f94fa3b6a7d418f71aaa51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/afd3325807f94fa3b6a7d418f71aaa51"}]}] Oct 28 09:39:06.851797 dv-cinder-zed-3-smb devstack@n-api.service[112029]: X-Tenant: admin Oct 28 09:39:06.851797 dv-cinder-zed-3-smb devstack@n-api.service[112029]: X-Tenant-Id: afd3325807f94fa3b6a7d418f71aaa51 Oct 28 09:39:06.851797 dv-cinder-zed-3-smb devstack@n-api.service[112029]: X-Tenant-Name: admin Oct 28 09:39:06.851797 dv-cinder-zed-3-smb devstack@n-api.service[112029]: X-User: admin Oct 28 09:39:06.851797 dv-cinder-zed-3-smb devstack@n-api.service[112029]: X-User-Domain-Id: default Oct 28 09:39:06.851797 dv-cinder-zed-3-smb devstack@n-api.service[112029]: X-User-Domain-Name: Default Oct 28 09:39:06.851797 dv-cinder-zed-3-smb devstack@n-api.service[112029]: X-User-Id: 66bbceeaa7394d2b922231b2c11b4f8f Oct 28 09:39:06.851797 dv-cinder-zed-3-smb devstack@n-api.service[112029]: X-User-Name: admin Oct 28 09:39:06.851797 dv-cinder-zed-3-smb devstack@n-api.service[112029]: method: > Oct 28 09:39:06.851797 dv-cinder-zed-3-smb devstack@n-api.service[112029]: exception: Flavor 451 could not be found. Oct 28 09:39:06.851797 dv-cinder-zed-3-smb devstack@n-api.service[112029]: action_args: {'id': '451'} Oct 28 09:39:06.851797 dv-cinder-zed-3-smb devstack@n-api.service[112029]: {{(pid=112029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:39:06.851797 dv-cinder-zed-3-smb devstack@n-api.service[112029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:39:06.852655 dv-cinder-zed-3-smb devstack@n-api.service[112029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 28 09:39:06.852655 dv-cinder-zed-3-smb devstack@n-api.service[112029]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 28 09:39:06.852655 dv-cinder-zed-3-smb devstack@n-api.service[112029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 28 09:39:06.852655 dv-cinder-zed-3-smb devstack@n-api.service[112029]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 28 09:39:06.852655 dv-cinder-zed-3-smb devstack@n-api.service[112029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 09:39:06.852655 dv-cinder-zed-3-smb devstack@n-api.service[112029]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 09:39:06.852655 dv-cinder-zed-3-smb devstack@n-api.service[112029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 28 09:39:06.852655 dv-cinder-zed-3-smb devstack@n-api.service[112029]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 28 09:39:06.852655 dv-cinder-zed-3-smb devstack@n-api.service[112029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 28 09:39:06.852655 dv-cinder-zed-3-smb devstack@n-api.service[112029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:39:06.852655 dv-cinder-zed-3-smb devstack@n-api.service[112029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 28 09:39:06.852655 dv-cinder-zed-3-smb devstack@n-api.service[112029]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 28 09:39:06.852655 dv-cinder-zed-3-smb devstack@n-api.service[112029]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 28 09:39:06.852655 dv-cinder-zed-3-smb devstack@n-api.service[112029]: ERROR nova.api.openstack.wsgi Oct 28 09:39:06.852655 dv-cinder-zed-3-smb devstack@n-api.service[112029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:39:06.852655 dv-cinder-zed-3-smb devstack@n-api.service[112029]: ERROR nova.api.openstack.wsgi Oct 28 09:39:06.852655 dv-cinder-zed-3-smb devstack@n-api.service[112029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:39:06.852655 dv-cinder-zed-3-smb devstack@n-api.service[112029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:39:06.852655 dv-cinder-zed-3-smb devstack@n-api.service[112029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:39:06.853805 dv-cinder-zed-3-smb devstack@n-api.service[112029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:39:06.853805 dv-cinder-zed-3-smb devstack@n-api.service[112029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:39:06.853805 dv-cinder-zed-3-smb devstack@n-api.service[112029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:39:06.853805 dv-cinder-zed-3-smb devstack@n-api.service[112029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:39:06.853805 dv-cinder-zed-3-smb devstack@n-api.service[112029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 28 09:39:06.853805 dv-cinder-zed-3-smb devstack@n-api.service[112029]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 28 09:39:06.853805 dv-cinder-zed-3-smb devstack@n-api.service[112029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 28 09:39:06.853805 dv-cinder-zed-3-smb devstack@n-api.service[112029]: ERROR nova.api.openstack.wsgi Oct 28 09:39:06.853805 dv-cinder-zed-3-smb devstack@n-api.service[112029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:39:06.853805 dv-cinder-zed-3-smb devstack@n-api.service[112029]: ERROR nova.api.openstack.wsgi Oct 28 09:39:06.853805 dv-cinder-zed-3-smb devstack@n-api.service[112029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:39:06.853805 dv-cinder-zed-3-smb devstack@n-api.service[112029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:39:06.853805 dv-cinder-zed-3-smb devstack@n-api.service[112029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:39:06.853805 dv-cinder-zed-3-smb devstack@n-api.service[112029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:39:06.853805 dv-cinder-zed-3-smb devstack@n-api.service[112029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:39:06.853805 dv-cinder-zed-3-smb devstack@n-api.service[112029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 28 09:39:06.853805 dv-cinder-zed-3-smb devstack@n-api.service[112029]: ERROR nova.api.openstack.wsgi Oct 28 09:39:06.853805 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi [None req-e38cca46-a6fd-4ca8-8b7a-9b966874eea2 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=112029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:39:06.854926 dv-cinder-zed-3-smb devstack@n-api.service[112029]: INFO nova.api.openstack.requestlog [None req-e38cca46-a6fd-4ca8-8b7a-9b966874eea2 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.433662 Oct 28 09:39:06.854926 dv-cinder-zed-3-smb devstack@n-api.service[112029]: [pid: 112029|app: 0|req: 24/49] 10.222.0.52 () {60 vars in 1193 bytes} [Fri Oct 28 09:39:06 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 435 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 28 09:39:06.861973 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi [None req-f027229f-c626-4f09-bdc4-556d2eb93564 admin admin] Calling method '>' {{(pid=112028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:39:06.877345 dv-cinder-zed-3-smb devstack@n-api.service[112028]: INFO nova.api.openstack.requestlog [None req-f027229f-c626-4f09-bdc4-556d2eb93564 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018973 Oct 28 09:39:06.877918 dv-cinder-zed-3-smb devstack@n-api.service[112028]: [pid: 112028|app: 0|req: 26/50] 10.222.0.52 () {60 vars in 1210 bytes} [Fri Oct 28 09:39:06 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:39:06.888500 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi [None req-217c42b2-8ade-4a1c-922b-bd3dd1873e2d admin admin] Calling method '>' {{(pid=112029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:39:06.904648 dv-cinder-zed-3-smb devstack@n-api.service[112029]: INFO nova.api.openstack.requestlog [None req-217c42b2-8ade-4a1c-922b-bd3dd1873e2d admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019832 Oct 28 09:39:06.905485 dv-cinder-zed-3-smb devstack@n-api.service[112029]: [pid: 112029|app: 0|req: 25/51] 10.222.0.52 () {60 vars in 1210 bytes} [Fri Oct 28 09:39:06 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:39:06.914948 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi [None req-eecb8e23-0624-4e8f-975a-77b23274d919 admin admin] Calling method '>' {{(pid=112028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:39:06.920596 dv-cinder-zed-3-smb devstack@n-api.service[112028]: INFO nova.api.openstack.wsgi [None req-eecb8e23-0624-4e8f-975a-77b23274d919 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 28 09:39:06.922278 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi [None req-eecb8e23-0624-4e8f-975a-77b23274d919 admin admin] Request method failure captured: Oct 28 09:39:06.922278 dv-cinder-zed-3-smb devstack@n-api.service[112028]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 28 09:39:06.922278 dv-cinder-zed-3-smb devstack@n-api.service[112028]: Accept: application/json Oct 28 09:39:06.922278 dv-cinder-zed-3-smb devstack@n-api.service[112028]: Accept-Encoding: gzip, deflate Oct 28 09:39:06.922278 dv-cinder-zed-3-smb devstack@n-api.service[112028]: Connection: keep-alive Oct 28 09:39:06.922278 dv-cinder-zed-3-smb devstack@n-api.service[112028]: Content-Length: 0 Oct 28 09:39:06.922278 dv-cinder-zed-3-smb devstack@n-api.service[112028]: Host: 10.222.0.52 Oct 28 09:39:06.922278 dv-cinder-zed-3-smb devstack@n-api.service[112028]: Openstack-Api-Version: compute 2.92 Oct 28 09:39:06.922278 dv-cinder-zed-3-smb devstack@n-api.service[112028]: Openstack-System-Scope: None Oct 28 09:39:06.922278 dv-cinder-zed-3-smb devstack@n-api.service[112028]: User-Agent: python-novaclient Oct 28 09:39:06.922278 dv-cinder-zed-3-smb devstack@n-api.service[112028]: X-Auth-Token: gAAAAABjW6M6WzDlqKVmT4tkpjPZJG0IDlWs3Ol4pvh0UtiJ2Ww--vDPueQ3LTG2psKlLI2W_NGAPmxbhFYJSMPdEKC3HzdpKuzTemzHnEpZh5Im_SI4iCDiUHgFghpkCigAX1HksLVhPKRTQemtIJS59lBtJpq75WFZJY2-cCy8yYTE4NnmhKo Oct 28 09:39:06.922278 dv-cinder-zed-3-smb devstack@n-api.service[112028]: X-Domain-Id: None Oct 28 09:39:06.922278 dv-cinder-zed-3-smb devstack@n-api.service[112028]: X-Domain-Name: None Oct 28 09:39:06.922278 dv-cinder-zed-3-smb devstack@n-api.service[112028]: X-Identity-Status: Confirmed Oct 28 09:39:06.922278 dv-cinder-zed-3-smb devstack@n-api.service[112028]: X-Is-Admin-Project: True Oct 28 09:39:06.922278 dv-cinder-zed-3-smb devstack@n-api.service[112028]: X-Openstack-Nova-Api-Version: 2.92 Oct 28 09:39:06.922278 dv-cinder-zed-3-smb devstack@n-api.service[112028]: X-Project-Domain-Id: default Oct 28 09:39:06.922278 dv-cinder-zed-3-smb devstack@n-api.service[112028]: X-Project-Domain-Name: Default Oct 28 09:39:06.922278 dv-cinder-zed-3-smb devstack@n-api.service[112028]: X-Project-Id: afd3325807f94fa3b6a7d418f71aaa51 Oct 28 09:39:06.922278 dv-cinder-zed-3-smb devstack@n-api.service[112028]: X-Project-Name: admin Oct 28 09:39:06.922278 dv-cinder-zed-3-smb devstack@n-api.service[112028]: X-Role: admin,reader,member Oct 28 09:39:06.922278 dv-cinder-zed-3-smb devstack@n-api.service[112028]: X-Roles: admin,reader,member Oct 28 09:39:06.923863 dv-cinder-zed-3-smb devstack@n-api.service[112028]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_afd3325807f94fa3b6a7d418f71aaa51"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/afd3325807f94fa3b6a7d418f71aaa51"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/afd3325807f94fa3b6a7d418f71aaa51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/afd3325807f94fa3b6a7d418f71aaa51"}]}] Oct 28 09:39:06.923863 dv-cinder-zed-3-smb devstack@n-api.service[112028]: X-Tenant: admin Oct 28 09:39:06.923863 dv-cinder-zed-3-smb devstack@n-api.service[112028]: X-Tenant-Id: afd3325807f94fa3b6a7d418f71aaa51 Oct 28 09:39:06.923863 dv-cinder-zed-3-smb devstack@n-api.service[112028]: X-Tenant-Name: admin Oct 28 09:39:06.923863 dv-cinder-zed-3-smb devstack@n-api.service[112028]: X-User: admin Oct 28 09:39:06.923863 dv-cinder-zed-3-smb devstack@n-api.service[112028]: X-User-Domain-Id: default Oct 28 09:39:06.923863 dv-cinder-zed-3-smb devstack@n-api.service[112028]: X-User-Domain-Name: Default Oct 28 09:39:06.923863 dv-cinder-zed-3-smb devstack@n-api.service[112028]: X-User-Id: 66bbceeaa7394d2b922231b2c11b4f8f Oct 28 09:39:06.923863 dv-cinder-zed-3-smb devstack@n-api.service[112028]: X-User-Name: admin Oct 28 09:39:06.923863 dv-cinder-zed-3-smb devstack@n-api.service[112028]: method: > Oct 28 09:39:06.923863 dv-cinder-zed-3-smb devstack@n-api.service[112028]: exception: Flavor 451 could not be found. Oct 28 09:39:06.923863 dv-cinder-zed-3-smb devstack@n-api.service[112028]: action_args: {'id': '451'} Oct 28 09:39:06.923863 dv-cinder-zed-3-smb devstack@n-api.service[112028]: {{(pid=112028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:39:06.923863 dv-cinder-zed-3-smb devstack@n-api.service[112028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:39:06.926764 dv-cinder-zed-3-smb devstack@n-api.service[112028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 28 09:39:06.926764 dv-cinder-zed-3-smb devstack@n-api.service[112028]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 28 09:39:06.926764 dv-cinder-zed-3-smb devstack@n-api.service[112028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 28 09:39:06.926764 dv-cinder-zed-3-smb devstack@n-api.service[112028]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 28 09:39:06.926764 dv-cinder-zed-3-smb devstack@n-api.service[112028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 09:39:06.926764 dv-cinder-zed-3-smb devstack@n-api.service[112028]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 09:39:06.926764 dv-cinder-zed-3-smb devstack@n-api.service[112028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 28 09:39:06.926764 dv-cinder-zed-3-smb devstack@n-api.service[112028]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 28 09:39:06.926764 dv-cinder-zed-3-smb devstack@n-api.service[112028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 28 09:39:06.926764 dv-cinder-zed-3-smb devstack@n-api.service[112028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:39:06.926764 dv-cinder-zed-3-smb devstack@n-api.service[112028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 28 09:39:06.926764 dv-cinder-zed-3-smb devstack@n-api.service[112028]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 28 09:39:06.926764 dv-cinder-zed-3-smb devstack@n-api.service[112028]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 28 09:39:06.926764 dv-cinder-zed-3-smb devstack@n-api.service[112028]: ERROR nova.api.openstack.wsgi Oct 28 09:39:06.926764 dv-cinder-zed-3-smb devstack@n-api.service[112028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:39:06.926764 dv-cinder-zed-3-smb devstack@n-api.service[112028]: ERROR nova.api.openstack.wsgi Oct 28 09:39:06.926764 dv-cinder-zed-3-smb devstack@n-api.service[112028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:39:06.926764 dv-cinder-zed-3-smb devstack@n-api.service[112028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:39:06.926764 dv-cinder-zed-3-smb devstack@n-api.service[112028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:39:06.928767 dv-cinder-zed-3-smb devstack@n-api.service[112028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:39:06.928767 dv-cinder-zed-3-smb devstack@n-api.service[112028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:39:06.928767 dv-cinder-zed-3-smb devstack@n-api.service[112028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:39:06.928767 dv-cinder-zed-3-smb devstack@n-api.service[112028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:39:06.928767 dv-cinder-zed-3-smb devstack@n-api.service[112028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 28 09:39:06.928767 dv-cinder-zed-3-smb devstack@n-api.service[112028]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 28 09:39:06.928767 dv-cinder-zed-3-smb devstack@n-api.service[112028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 28 09:39:06.928767 dv-cinder-zed-3-smb devstack@n-api.service[112028]: ERROR nova.api.openstack.wsgi Oct 28 09:39:06.928767 dv-cinder-zed-3-smb devstack@n-api.service[112028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:39:06.928767 dv-cinder-zed-3-smb devstack@n-api.service[112028]: ERROR nova.api.openstack.wsgi Oct 28 09:39:06.928767 dv-cinder-zed-3-smb devstack@n-api.service[112028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:39:06.928767 dv-cinder-zed-3-smb devstack@n-api.service[112028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:39:06.928767 dv-cinder-zed-3-smb devstack@n-api.service[112028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:39:06.928767 dv-cinder-zed-3-smb devstack@n-api.service[112028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:39:06.928767 dv-cinder-zed-3-smb devstack@n-api.service[112028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:39:06.928767 dv-cinder-zed-3-smb devstack@n-api.service[112028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 28 09:39:06.928767 dv-cinder-zed-3-smb devstack@n-api.service[112028]: ERROR nova.api.openstack.wsgi Oct 28 09:39:06.928767 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi [None req-eecb8e23-0624-4e8f-975a-77b23274d919 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=112028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:39:06.931234 dv-cinder-zed-3-smb devstack@n-api.service[112028]: INFO nova.api.openstack.requestlog [None req-eecb8e23-0624-4e8f-975a-77b23274d919 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.012367 Oct 28 09:39:06.931234 dv-cinder-zed-3-smb devstack@n-api.service[112028]: [pid: 112028|app: 0|req: 27/52] 10.222.0.52 () {60 vars in 1193 bytes} [Fri Oct 28 09:39:06 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 28 09:39:08.236142 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi [None req-217c42b2-8ade-4a1c-922b-bd3dd1873e2d admin admin] Calling method '>' {{(pid=112029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:39:08.237183 dv-cinder-zed-3-smb devstack@n-api.service[112029]: INFO nova.api.openstack.requestlog [None req-217c42b2-8ade-4a1c-922b-bd3dd1873e2d admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001550 Oct 28 09:39:08.237581 dv-cinder-zed-3-smb devstack@n-api.service[112029]: [pid: 112029|app: 0|req: 26/53] 10.222.0.52 () {56 vars in 1074 bytes} [Fri Oct 28 09:39:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 09:39:08.797482 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi [None req-7178dcab-1c61-4952-a8c2-58fbb4a8efa5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:39:08.821096 dv-cinder-zed-3-smb devstack@n-api.service[112028]: INFO nova.api.openstack.requestlog [None req-7178dcab-1c61-4952-a8c2-58fbb4a8efa5 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.446697 Oct 28 09:39:08.821656 dv-cinder-zed-3-smb devstack@n-api.service[112028]: [pid: 112028|app: 0|req: 28/54] 10.222.0.52 () {64 vars in 1235 bytes} [Fri Oct 28 09:39:08 2022] POST /compute/v2.1/flavors => generated 404 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 09:39:10.093665 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi [None req-217c42b2-8ade-4a1c-922b-bd3dd1873e2d admin admin] Calling method '>' {{(pid=112029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:39:10.094697 dv-cinder-zed-3-smb devstack@n-api.service[112029]: INFO nova.api.openstack.requestlog [None req-217c42b2-8ade-4a1c-922b-bd3dd1873e2d admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001746 Oct 28 09:39:10.095130 dv-cinder-zed-3-smb devstack@n-api.service[112029]: [pid: 112029|app: 0|req: 27/55] 10.222.0.52 () {56 vars in 1074 bytes} [Fri Oct 28 09:39:10 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:39:10.683391 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi [None req-e656eee7-662d-4fa6-bbf8-c05259da847c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:39:10.701893 dv-cinder-zed-3-smb devstack@n-api.service[112028]: INFO nova.api.openstack.requestlog [None req-e656eee7-662d-4fa6-bbf8-c05259da847c admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.468614 Oct 28 09:39:10.702443 dv-cinder-zed-3-smb devstack@n-api.service[112028]: [pid: 112028|app: 0|req: 29/56] 10.222.0.52 () {64 vars in 1235 bytes} [Fri Oct 28 09:39:10 2022] POST /compute/v2.1/flavors => generated 405 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 09:39:12.051288 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi [None req-217c42b2-8ade-4a1c-922b-bd3dd1873e2d admin admin] Calling method '>' {{(pid=112029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:39:12.052353 dv-cinder-zed-3-smb devstack@n-api.service[112029]: INFO nova.api.openstack.requestlog [None req-217c42b2-8ade-4a1c-922b-bd3dd1873e2d admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001564 Oct 28 09:39:12.052765 dv-cinder-zed-3-smb devstack@n-api.service[112029]: [pid: 112029|app: 0|req: 28/57] 10.222.0.52 () {56 vars in 1074 bytes} [Fri Oct 28 09:39:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 09:39:12.609904 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi [None req-96f48e7b-fabf-4517-88e1-b15f199870bc admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:39:12.631853 dv-cinder-zed-3-smb devstack@n-api.service[112028]: INFO nova.api.openstack.requestlog [None req-96f48e7b-fabf-4517-88e1-b15f199870bc admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.438510 Oct 28 09:39:12.632413 dv-cinder-zed-3-smb devstack@n-api.service[112028]: [pid: 112028|app: 0|req: 30/58] 10.222.0.52 () {64 vars in 1235 bytes} [Fri Oct 28 09:39:12 2022] POST /compute/v2.1/flavors => generated 407 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 09:39:13.912098 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi [None req-217c42b2-8ade-4a1c-922b-bd3dd1873e2d admin admin] Calling method '>' {{(pid=112029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:39:13.913115 dv-cinder-zed-3-smb devstack@n-api.service[112029]: INFO nova.api.openstack.requestlog [None req-217c42b2-8ade-4a1c-922b-bd3dd1873e2d admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001555 Oct 28 09:39:13.913509 dv-cinder-zed-3-smb devstack@n-api.service[112029]: [pid: 112029|app: 0|req: 29/59] 10.222.0.52 () {56 vars in 1074 bytes} [Fri Oct 28 09:39:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:39:14.512848 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi [None req-10c8e7e7-95ef-408f-9cf5-ea85de5a2a2f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:39:14.533640 dv-cinder-zed-3-smb devstack@n-api.service[112028]: INFO nova.api.openstack.requestlog [None req-10c8e7e7-95ef-408f-9cf5-ea85de5a2a2f admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.480382 Oct 28 09:39:14.534202 dv-cinder-zed-3-smb devstack@n-api.service[112028]: [pid: 112028|app: 0|req: 31/60] 10.222.0.52 () {64 vars in 1235 bytes} [Fri Oct 28 09:39:14 2022] POST /compute/v2.1/flavors => generated 409 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 09:39:15.874608 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi [None req-217c42b2-8ade-4a1c-922b-bd3dd1873e2d admin admin] Calling method '>' {{(pid=112029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:39:15.875617 dv-cinder-zed-3-smb devstack@n-api.service[112029]: INFO nova.api.openstack.requestlog [None req-217c42b2-8ade-4a1c-922b-bd3dd1873e2d admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Oct 28 09:39:15.876072 dv-cinder-zed-3-smb devstack@n-api.service[112029]: [pid: 112029|app: 0|req: 30/61] 10.222.0.52 () {56 vars in 1074 bytes} [Fri Oct 28 09:39:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:39:16.441457 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi [None req-853b60fa-1113-422d-998f-60789910e327 admin admin] Calling method '>' {{(pid=112028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:39:16.462919 dv-cinder-zed-3-smb devstack@n-api.service[112028]: INFO nova.api.openstack.requestlog [None req-853b60fa-1113-422d-998f-60789910e327 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.448843 Oct 28 09:39:16.463505 dv-cinder-zed-3-smb devstack@n-api.service[112028]: [pid: 112028|app: 0|req: 32/62] 10.222.0.52 () {60 vars in 1202 bytes} [Fri Oct 28 09:39:16 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:40:07.569447 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi [None req-217c42b2-8ade-4a1c-922b-bd3dd1873e2d admin admin] Calling method '>' {{(pid=112029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:40:07.570461 dv-cinder-zed-3-smb devstack@n-api.service[112029]: INFO nova.api.openstack.requestlog [None req-217c42b2-8ade-4a1c-922b-bd3dd1873e2d admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Oct 28 09:40:07.570862 dv-cinder-zed-3-smb devstack@n-api.service[112029]: [pid: 112029|app: 0|req: 31/63] 10.222.0.52 () {54 vars in 931 bytes} [Fri Oct 28 09:40:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:40:07.581789 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG dbcounter [-] [112028] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=112028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:40:07.982023 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi [None req-7f03eb25-8d9a-4d14-ad04-3a8a39e85e81 admin admin] Calling method '>' {{(pid=112028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:40:08.003078 dv-cinder-zed-3-smb devstack@n-api.service[112028]: INFO nova.api.openstack.requestlog [None req-7f03eb25-8d9a-4d14-ad04-3a8a39e85e81 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.425806 Oct 28 09:40:08.003635 dv-cinder-zed-3-smb devstack@n-api.service[112028]: [pid: 112028|app: 0|req: 33/64] 10.222.0.52 () {60 vars in 1292 bytes} [Fri Oct 28 09:40:07 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:40:08.024835 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG dbcounter [-] [112029] Writing DB stats nova_api:SELECT=14 {{(pid=112029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:40:08.028614 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi [None req-00e3d676-970e-4030-9bda-27b73ae94b28 admin admin] Calling method '>' {{(pid=112029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:40:08.036756 dv-cinder-zed-3-smb devstack@n-api.service[112029]: INFO nova.api.openstack.requestlog [None req-00e3d676-970e-4030-9bda-27b73ae94b28 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013357 Oct 28 09:40:08.037304 dv-cinder-zed-3-smb devstack@n-api.service[112029]: [pid: 112029|app: 0|req: 32/65] 10.222.0.52 () {60 vars in 1283 bytes} [Fri Oct 28 09:40:08 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:40:08.049248 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi [None req-d38a97da-cbdf-4607-89e4-ae22be2a5ede admin admin] Calling method '>' {{(pid=112028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:40:08.056893 dv-cinder-zed-3-smb devstack@n-api.service[112028]: INFO nova.api.openstack.requestlog [None req-d38a97da-cbdf-4607-89e4-ae22be2a5ede admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011251 Oct 28 09:40:08.057447 dv-cinder-zed-3-smb devstack@n-api.service[112028]: [pid: 112028|app: 0|req: 34/66] 10.222.0.52 () {60 vars in 1286 bytes} [Fri Oct 28 09:40:08 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:40:08.069902 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi [None req-9bf01868-ee69-454c-b92a-4319649a75f3 admin admin] Calling method '>' {{(pid=112029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:40:08.077384 dv-cinder-zed-3-smb devstack@n-api.service[112029]: INFO nova.api.openstack.requestlog [None req-9bf01868-ee69-454c-b92a-4319649a75f3 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011036 Oct 28 09:40:08.077933 dv-cinder-zed-3-smb devstack@n-api.service[112029]: [pid: 112029|app: 0|req: 33/67] 10.222.0.52 () {60 vars in 1286 bytes} [Fri Oct 28 09:40:08 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:40:08.090319 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi [None req-cc6b5055-e2f3-4ec9-876d-2af8493aaa3c admin admin] Calling method '>' {{(pid=112028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:40:08.098049 dv-cinder-zed-3-smb devstack@n-api.service[112028]: INFO nova.api.openstack.requestlog [None req-cc6b5055-e2f3-4ec9-876d-2af8493aaa3c admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011395 Oct 28 09:40:08.098582 dv-cinder-zed-3-smb devstack@n-api.service[112028]: [pid: 112028|app: 0|req: 35/68] 10.222.0.52 () {60 vars in 1283 bytes} [Fri Oct 28 09:40:08 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:43:13.497228 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi [None req-9bf01868-ee69-454c-b92a-4319649a75f3 admin admin] Calling method '>' {{(pid=112029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:43:13.498365 dv-cinder-zed-3-smb devstack@n-api.service[112029]: INFO nova.api.openstack.requestlog [None req-9bf01868-ee69-454c-b92a-4319649a75f3 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001560 Oct 28 09:43:13.498771 dv-cinder-zed-3-smb devstack@n-api.service[112029]: [pid: 112029|app: 0|req: 34/69] 10.222.0.52 () {56 vars in 1074 bytes} [Fri Oct 28 09:43:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:43:13.636122 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG dbcounter [-] [112028] Writing DB stats nova_api:SELECT=6 {{(pid=112028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:43:13.795221 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi [None req-21b3f316-7dfb-494b-b882-3db0daff64eb admin admin] Calling method '>' {{(pid=112028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:43:13.800000 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG oslo_concurrency.lockutils [None req-21b3f316-7dfb-494b-b882-3db0daff64eb admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:43:13.800471 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG oslo_concurrency.lockutils [None req-21b3f316-7dfb-494b-b882-3db0daff64eb admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:43:13.800901 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG oslo_concurrency.lockutils [None req-21b3f316-7dfb-494b-b882-3db0daff64eb admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:43:13.801612 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG oslo_concurrency.lockutils [None req-21b3f316-7dfb-494b-b882-3db0daff64eb admin admin] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:43:13.802056 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG oslo_concurrency.lockutils [None req-21b3f316-7dfb-494b-b882-3db0daff64eb admin admin] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:43:13.802472 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG oslo_concurrency.lockutils [None req-21b3f316-7dfb-494b-b882-3db0daff64eb admin admin] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:43:13.834164 dv-cinder-zed-3-smb devstack@n-api.service[112028]: INFO nova.api.openstack.requestlog [None req-21b3f316-7dfb-494b-b882-3db0daff64eb admin admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 776 microversion: 2.92 time: 0.199235 Oct 28 09:43:13.834726 dv-cinder-zed-3-smb devstack@n-api.service[112028]: [pid: 112028|app: 0|req: 36/70] 10.222.0.52 () {60 vars in 1193 bytes} [Fri Oct 28 09:43:13 2022] GET /compute/v2.1/os-services => generated 776 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 09:43:14.920604 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi [None req-9bf01868-ee69-454c-b92a-4319649a75f3 admin admin] Calling method '>' {{(pid=112029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:43:14.921635 dv-cinder-zed-3-smb devstack@n-api.service[112029]: INFO nova.api.openstack.requestlog [None req-9bf01868-ee69-454c-b92a-4319649a75f3 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001534 Oct 28 09:43:14.922046 dv-cinder-zed-3-smb devstack@n-api.service[112029]: [pid: 112029|app: 0|req: 35/71] 10.222.0.52 () {56 vars in 1074 bytes} [Fri Oct 28 09:43:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:43:15.110308 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi [None req-eda11c0e-4731-419a-8a0c-6de1fc28942e admin admin] Calling method '>' {{(pid=112028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:43:15.114201 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG oslo_concurrency.lockutils [None req-eda11c0e-4731-419a-8a0c-6de1fc28942e admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:43:15.114665 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG oslo_concurrency.lockutils [None req-eda11c0e-4731-419a-8a0c-6de1fc28942e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:43:15.115082 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG oslo_concurrency.lockutils [None req-eda11c0e-4731-419a-8a0c-6de1fc28942e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:43:15.115807 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG oslo_concurrency.lockutils [None req-eda11c0e-4731-419a-8a0c-6de1fc28942e admin admin] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:43:15.116247 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG oslo_concurrency.lockutils [None req-eda11c0e-4731-419a-8a0c-6de1fc28942e admin admin] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:43:15.116654 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG oslo_concurrency.lockutils [None req-eda11c0e-4731-419a-8a0c-6de1fc28942e admin admin] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:43:15.136453 dv-cinder-zed-3-smb devstack@n-api.service[112028]: INFO nova.api.openstack.requestlog [None req-eda11c0e-4731-419a-8a0c-6de1fc28942e admin admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 776 microversion: 2.92 time: 0.078170 Oct 28 09:43:15.137007 dv-cinder-zed-3-smb devstack@n-api.service[112028]: [pid: 112028|app: 0|req: 37/72] 10.222.0.52 () {60 vars in 1193 bytes} [Fri Oct 28 09:43:15 2022] GET /compute/v2.1/os-services => generated 776 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 09:43:26.618667 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi [None req-9bf01868-ee69-454c-b92a-4319649a75f3 admin admin] Calling method '>' {{(pid=112029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:43:26.619677 dv-cinder-zed-3-smb devstack@n-api.service[112029]: INFO nova.api.openstack.requestlog [None req-9bf01868-ee69-454c-b92a-4319649a75f3 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Oct 28 09:43:26.620111 dv-cinder-zed-3-smb devstack@n-api.service[112029]: [pid: 112029|app: 0|req: 36/73] 10.222.0.52 () {56 vars in 1074 bytes} [Fri Oct 28 09:43:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:43:26.764445 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG dbcounter [-] [112028] Writing DB stats nova_cell0:SELECT=4 {{(pid=112028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:43:26.765187 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG dbcounter [-] [112028] Writing DB stats nova_cell1:SELECT=4 {{(pid=112028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:43:26.765822 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG dbcounter [-] [112028] Writing DB stats nova_api:SELECT=8 {{(pid=112028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:43:26.812748 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi [None req-9d8525fe-7411-424a-a7c7-07026cf813d4 admin admin] Calling method '>' {{(pid=112028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:43:26.816825 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG oslo_concurrency.lockutils [None req-9d8525fe-7411-424a-a7c7-07026cf813d4 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:43:26.817296 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG oslo_concurrency.lockutils [None req-9d8525fe-7411-424a-a7c7-07026cf813d4 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:43:26.817717 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG oslo_concurrency.lockutils [None req-9d8525fe-7411-424a-a7c7-07026cf813d4 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:43:26.818425 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG oslo_concurrency.lockutils [None req-9d8525fe-7411-424a-a7c7-07026cf813d4 admin admin] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:43:26.818869 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG oslo_concurrency.lockutils [None req-9d8525fe-7411-424a-a7c7-07026cf813d4 admin admin] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:43:26.819282 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG oslo_concurrency.lockutils [None req-9d8525fe-7411-424a-a7c7-07026cf813d4 admin admin] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:43:26.844892 dv-cinder-zed-3-smb devstack@n-api.service[112028]: INFO nova.api.openstack.requestlog [None req-9d8525fe-7411-424a-a7c7-07026cf813d4 admin admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 996 microversion: 2.92 time: 0.084850 Oct 28 09:43:26.845369 dv-cinder-zed-3-smb devstack@n-api.service[112028]: [pid: 112028|app: 0|req: 38/74] 10.222.0.52 () {60 vars in 1193 bytes} [Fri Oct 28 09:43:26 2022] GET /compute/v2.1/os-services => generated 996 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 09:43:27.936977 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG nova.api.openstack.wsgi [None req-9bf01868-ee69-454c-b92a-4319649a75f3 admin admin] Calling method '>' {{(pid=112029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:43:27.937981 dv-cinder-zed-3-smb devstack@n-api.service[112029]: INFO nova.api.openstack.requestlog [None req-9bf01868-ee69-454c-b92a-4319649a75f3 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Oct 28 09:43:27.938375 dv-cinder-zed-3-smb devstack@n-api.service[112029]: [pid: 112029|app: 0|req: 37/75] 10.222.0.52 () {56 vars in 1074 bytes} [Fri Oct 28 09:43:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:43:28.130901 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG nova.api.openstack.wsgi [None req-a3e55b90-4df6-4e24-9971-817e20fbafa3 admin admin] Calling method '>' {{(pid=112028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:43:28.134505 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG oslo_concurrency.lockutils [None req-a3e55b90-4df6-4e24-9971-817e20fbafa3 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:43:28.135056 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG oslo_concurrency.lockutils [None req-a3e55b90-4df6-4e24-9971-817e20fbafa3 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:43:28.135488 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG oslo_concurrency.lockutils [None req-a3e55b90-4df6-4e24-9971-817e20fbafa3 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:43:28.136232 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG oslo_concurrency.lockutils [None req-a3e55b90-4df6-4e24-9971-817e20fbafa3 admin admin] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:43:28.136679 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG oslo_concurrency.lockutils [None req-a3e55b90-4df6-4e24-9971-817e20fbafa3 admin admin] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:43:28.137095 dv-cinder-zed-3-smb devstack@n-api.service[112028]: DEBUG oslo_concurrency.lockutils [None req-a3e55b90-4df6-4e24-9971-817e20fbafa3 admin admin] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:43:28.159154 dv-cinder-zed-3-smb devstack@n-api.service[112028]: INFO nova.api.openstack.requestlog [None req-a3e55b90-4df6-4e24-9971-817e20fbafa3 admin admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 996 microversion: 2.92 time: 0.081327 Oct 28 09:43:28.159729 dv-cinder-zed-3-smb devstack@n-api.service[112028]: [pid: 112028|app: 0|req: 39/76] 10.222.0.52 () {60 vars in 1193 bytes} [Fri Oct 28 09:43:28 2022] GET /compute/v2.1/os-services => generated 996 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 09:44:35.810930 dv-cinder-zed-3-smb systemd[1]: Stopping Devstack devstack@n-api.service... Oct 28 09:44:35.811685 dv-cinder-zed-3-smb devstack@n-api.service[112025]: Fri Oct 28 09:44:35 2022 - graceful shutdown triggered... Oct 28 09:44:35.812211 dv-cinder-zed-3-smb devstack@n-api.service[112028]: Gracefully killing worker 1 (pid: 112028)... Oct 28 09:44:35.812571 dv-cinder-zed-3-smb devstack@n-api.service[112029]: Gracefully killing worker 2 (pid: 112029)... Oct 28 09:44:35.939536 dv-cinder-zed-3-smb devstack@n-api.service[112029]: DEBUG dbcounter [-] [112029] Writing DB stats nova_api:SELECT=4 {{(pid=112029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:44:36.812855 dv-cinder-zed-3-smb devstack@n-api.service[112025]: worker 1 buried after 1 seconds Oct 28 09:44:36.813471 dv-cinder-zed-3-smb devstack@n-api.service[112025]: worker 2 buried after 1 seconds Oct 28 09:44:36.813471 dv-cinder-zed-3-smb devstack@n-api.service[112025]: goodbye to uWSGI. Oct 28 09:44:36.814486 dv-cinder-zed-3-smb systemd[1]: devstack@n-api.service: Succeeded. Oct 28 09:44:36.815050 dv-cinder-zed-3-smb systemd[1]: Stopped Devstack devstack@n-api.service. Oct 28 09:44:36.817896 dv-cinder-zed-3-smb systemd[1]: Starting Devstack devstack@n-api.service... Oct 28 09:44:36.829850 dv-cinder-zed-3-smb devstack@n-api.service[127012]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 28 09:44:36.832052 dv-cinder-zed-3-smb devstack@n-api.service[127012]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Oct 28 09:44:36 2022] *** Oct 28 09:44:36.832052 dv-cinder-zed-3-smb devstack@n-api.service[127012]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 28 09:44:36.832052 dv-cinder-zed-3-smb devstack@n-api.service[127012]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 28 09:44:36.832052 dv-cinder-zed-3-smb devstack@n-api.service[127012]: nodename: dv-cinder-zed-3-smb Oct 28 09:44:36.832052 dv-cinder-zed-3-smb devstack@n-api.service[127012]: machine: x86_64 Oct 28 09:44:36.832052 dv-cinder-zed-3-smb devstack@n-api.service[127012]: clock source: unix Oct 28 09:44:36.832052 dv-cinder-zed-3-smb devstack@n-api.service[127012]: pcre jit disabled Oct 28 09:44:36.832052 dv-cinder-zed-3-smb devstack@n-api.service[127012]: detected number of CPU cores: 4 Oct 28 09:44:36.832052 dv-cinder-zed-3-smb devstack@n-api.service[127012]: current working directory: / Oct 28 09:44:36.832052 dv-cinder-zed-3-smb devstack@n-api.service[127012]: detected binary path: /usr/bin/uwsgi-core Oct 28 09:44:36.832052 dv-cinder-zed-3-smb devstack@n-api.service[127012]: your processes number limit is 47680 Oct 28 09:44:36.832052 dv-cinder-zed-3-smb devstack@n-api.service[127012]: your memory page size is 4096 bytes Oct 28 09:44:36.832899 dv-cinder-zed-3-smb devstack@n-api.service[127012]: detected max file descriptor number: 2048 Oct 28 09:44:36.832899 dv-cinder-zed-3-smb devstack@n-api.service[127012]: lock engine: pthread robust mutexes Oct 28 09:44:36.832899 dv-cinder-zed-3-smb devstack@n-api.service[127012]: thunder lock: enabled Oct 28 09:44:36.832899 dv-cinder-zed-3-smb devstack@n-api.service[127012]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 28 09:44:36.832899 dv-cinder-zed-3-smb devstack@n-api.service[127012]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 28 09:44:36.881587 dv-cinder-zed-3-smb devstack@n-api.service[127012]: Python main interpreter initialized at 0x55752faaa9c0 Oct 28 09:44:36.881587 dv-cinder-zed-3-smb devstack@n-api.service[127012]: python threads support enabled Oct 28 09:44:36.881587 dv-cinder-zed-3-smb devstack@n-api.service[127012]: your server socket listen backlog is limited to 100 connections Oct 28 09:44:36.881587 dv-cinder-zed-3-smb devstack@n-api.service[127012]: your mercy for graceful operations on workers is 90 seconds Oct 28 09:44:36.882069 dv-cinder-zed-3-smb devstack@n-api.service[127012]: mapped 403077 bytes (393 KB) for 2 cores Oct 28 09:44:36.882154 dv-cinder-zed-3-smb devstack@n-api.service[127012]: *** Operational MODE: preforking *** Oct 28 09:44:36.883188 dv-cinder-zed-3-smb devstack@n-api.service[127012]: *** uWSGI is running in multiple interpreter mode *** Oct 28 09:44:36.883188 dv-cinder-zed-3-smb devstack@n-api.service[127012]: spawned uWSGI master process (pid: 127012) Oct 28 09:44:36.883397 dv-cinder-zed-3-smb systemd[1]: Started Devstack devstack@n-api.service. Oct 28 09:44:36.887771 dv-cinder-zed-3-smb devstack@n-api.service[127012]: spawned uWSGI worker 1 (pid: 127032, cores: 1) Oct 28 09:44:36.887771 dv-cinder-zed-3-smb devstack@n-api.service[127012]: spawned uWSGI worker 2 (pid: 127033, cores: 1) Oct 28 09:44:36.887771 dv-cinder-zed-3-smb devstack@n-api.service[127012]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 28 09:44:37.561412 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 28 09:44:37.570085 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 28 09:44:38.729292 dv-cinder-zed-3-smb devstack@n-api.service[127032]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 28 09:44:38.729292 dv-cinder-zed-3-smb devstack@n-api.service[127032]: from cryptography.utils import int_from_bytes Oct 28 09:44:38.730048 dv-cinder-zed-3-smb devstack@n-api.service[127032]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 28 09:44:38.730048 dv-cinder-zed-3-smb devstack@n-api.service[127032]: from cryptography.utils import int_from_bytes Oct 28 09:44:38.730194 dv-cinder-zed-3-smb devstack@n-api.service[127033]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 28 09:44:38.730194 dv-cinder-zed-3-smb devstack@n-api.service[127033]: from cryptography.utils import int_from_bytes Oct 28 09:44:38.730194 dv-cinder-zed-3-smb devstack@n-api.service[127033]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 28 09:44:38.730194 dv-cinder-zed-3-smb devstack@n-api.service[127033]: from cryptography.utils import int_from_bytes Oct 28 09:44:41.174285 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 28 09:44:41.174984 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 28 09:44:41.175099 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 28 09:44:41.175454 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 28 09:44:41.175717 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 28 09:44:41.176144 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.176479 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.176811 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.177144 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.177484 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.177805 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.178137 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.178466 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.178802 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.179069 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.179984 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.180483 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-zed-3-smb {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.180817 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.181135 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.181455 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.181785 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.182096 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.182426 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.182758 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.183277 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.183733 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.184079 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.184400 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.184753 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.185076 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.185401 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.185736 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.186055 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.186388 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.186723 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.187125 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-zed-3-smb {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.187469 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.187805 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.188216 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.188647 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.188969 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.189287 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.189617 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.189950 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.190266 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.190602 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.190929 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.191256 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.191587 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.191927 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.192246 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.192569 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.192899 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.193216 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.193529 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.193788 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.194105 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.194436 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.194913 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.195131 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.195386 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.195642 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.195997 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.196330 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.196610 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 28 09:44:41.197028 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.197123 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 28 09:44:41.197216 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.197324 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.197431 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 28 09:44:41.197527 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.197747 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 28 09:44:41.197857 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.198014 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 28 09:44:41.198181 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.198418 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.198522 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.198755 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.198845 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.199086 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.199228 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.199415 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.199515 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.199769 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.199874 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.200081 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.200180 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.200409 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.200511 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.200739 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.200828 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.52 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.201050 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.52 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.201139 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.201331 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.201428 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.201656 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.201752 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.202009 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.202105 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-zed-3-smb {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.202327 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.202426 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.202661 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.202765 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.202989 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.203105 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.203306 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.203404 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.203619 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.203709 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.203964 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.204057 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.204293 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.204384 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.204637 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.204809 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.204952 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.205131 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.205253 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.205449 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.205558 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.205770 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.205909 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.206118 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.206230 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.206432 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.206541 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.206744 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.206840 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.207058 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.207156 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.207365 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.207464 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.207680 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.207817 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.208025 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.208114 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.208336 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.208433 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-zed-3-smb {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.208649 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.208750 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.208963 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.209062 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.209277 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.209374 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.209588 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.209760 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.209903 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.210079 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.210216 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.210917 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.211062 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.211254 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.211393 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.211584 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.211724 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.211929 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.212064 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.212266 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.212363 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.212595 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.212701 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.212922 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.213020 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.213251 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.213354 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.213561 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.213652 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.213876 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.213965 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.214191 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.214291 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.214515 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.214610 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.214824 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.214913 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.215136 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.215239 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.215393 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.215498 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.215709 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.215870 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.216061 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.216174 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.216378 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.216483 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.216695 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.216796 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.216949 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.217040 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.217205 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.217306 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.217530 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.217638 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.217859 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.217957 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.218174 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.218273 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.218489 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.218588 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.218804 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.218893 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.219115 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.219203 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.219424 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.219521 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.219731 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.219866 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.220068 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.220165 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.220382 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.220486 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.220708 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.220799 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.221021 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.221111 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.221334 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.221433 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.221651 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.221739 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.221978 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.222067 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.222318 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.222408 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.52 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.222624 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.52 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.222723 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.222937 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.223028 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.223288 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.223380 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.223617 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.223710 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.223972 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.224074 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.224293 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.224393 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.224614 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.224712 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.224927 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.225029 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.225497 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.225597 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.225816 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.225924 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.226830 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.226948 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.227045 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.227129 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.227336 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.227427 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.227591 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.227694 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.227925 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.228027 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.228241 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.228342 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.228570 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.228670 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.228891 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.228981 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.229204 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.229301 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.229519 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.229624 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.229827 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.229925 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.230139 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.230229 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.230455 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.230546 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.230766 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.230857 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.231079 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.231169 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.231392 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.231490 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.231703 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.231835 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.232039 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.232138 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.232353 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.232453 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.232668 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.232759 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.232982 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.233079 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.233310 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.233408 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.233639 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.233736 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.233955 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.234059 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.234267 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.234358 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.234580 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.234678 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.234894 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.234984 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.235223 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.235354 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.235537 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.235640 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.235881 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.236017 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.236204 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.236318 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.236513 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.236621 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.236817 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.236928 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.237146 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.237298 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.237461 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.237561 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.237776 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.237880 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.238101 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.238198 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.238407 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.238505 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.238727 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.238825 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.239045 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.239134 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.239355 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.239452 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.239666 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.239796 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.240008 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.240101 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.240327 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.240426 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.240639 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.240736 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.240962 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.241062 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.241273 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.241364 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.241584 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.241695 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.241922 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.242027 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.242246 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.242338 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.242562 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.242650 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.242875 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.242964 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.243190 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.243281 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.243502 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.243591 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.243848 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:44:41.243954 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.244173 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.244271 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.244487 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.244577 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.244819 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.244922 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.245137 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.245228 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.245453 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.245558 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.245784 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.245899 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.246099 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.246225 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.246415 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.246517 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.246733 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.246846 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.247082 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.247171 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.247353 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.247451 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.247674 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.247814 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.248020 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.248121 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.248347 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.248439 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.248665 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.248762 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.248985 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.249074 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.249314 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.249411 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.249638 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.249730 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.249949 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.250037 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.250267 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.250356 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.250597 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.250731 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.250918 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.251021 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.251229 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.251341 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.251547 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.251654 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.251900 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.252001 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.252216 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.252328 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.252529 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.252637 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.252851 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.252958 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.253163 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.253276 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.253475 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.253574 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.253786 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.253899 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.254097 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.254211 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.254407 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.254513 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.254738 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.254837 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.255054 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.255155 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.255367 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.255479 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.255679 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.255815 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.256018 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.256142 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.256342 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.256452 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.256660 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.256760 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.256981 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.257069 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.257326 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.257445 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.257652 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.257763 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.257994 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.258094 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.258317 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.258415 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.258644 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.258819 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.258965 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.259056 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.259281 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.259376 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.259599 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.259701 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.259948 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.260039 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.260271 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.260373 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.260589 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.260692 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.260902 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.260992 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.261216 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.261313 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.261527 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.261626 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.261848 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.261937 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.262159 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.262247 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.262478 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.262575 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.262803 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.262900 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.263115 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.263203 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.263457 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.263549 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.263792 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.263898 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.264121 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.264228 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.264460 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.264558 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.264757 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.264861 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.265072 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.265170 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.265391 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.265483 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.265708 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.265796 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.266022 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.266118 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.266357 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.266505 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.266668 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.266787 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.266982 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.267088 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.267297 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.267439 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.267615 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.267877 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.268017 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.268126 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.268269 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.268368 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.268582 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.268690 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.268897 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.269024 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.269218 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.269357 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.269536 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.269628 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.269852 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.269950 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.270171 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.270264 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.270485 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.270574 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.270807 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.270932 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.271123 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.271226 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.271477 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.271627 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.271884 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.271977 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.272061 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.272153 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.272379 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.272479 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.272705 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.272796 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.273552 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.273649 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.273868 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.273970 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.274231 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.274346 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.274490 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.274649 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.274807 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.274908 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.275115 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.275208 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.275424 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.275522 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.275733 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.275857 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.276148 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.276261 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.276363 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.276466 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.276698 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.276824 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.277014 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.277106 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.277323 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.277431 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.277630 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.277730 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.277943 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.278101 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.278258 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.278348 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.278571 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.278670 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.278885 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.278975 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.279196 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.279286 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.279550 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.279641 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.279895 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.280000 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.280210 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.280309 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.280532 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.280622 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.280853 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.280955 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.281168 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.281266 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.281484 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.281580 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.281802 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.281899 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.282118 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.282216 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.282441 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.282536 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.282761 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.283061 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.283152 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.283389 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.283486 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.283707 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.283848 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.284055 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.284144 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.284376 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.284478 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.284687 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.284783 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.285009 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.285098 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.285329 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.285427 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.285650 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.285748 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.285964 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.286055 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.286285 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.286383 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.286614 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.286744 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.286939 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.287197 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.287299 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.287537 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.287635 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.287886 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.287992 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.288205 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.288307 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.289156 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.289262 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.289494 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.289589 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.289917 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.290117 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.290205 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.290301 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.290464 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.290554 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.290778 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.290876 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.291096 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.291204 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.291406 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.291486 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.291719 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.291829 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.292071 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.292174 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.292384 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.292475 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.292696 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.292787 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.293008 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.293108 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.293332 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.293429 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.293702 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.293813 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.293952 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.294046 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.294257 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.294350 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.294646 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.294760 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.294885 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.294985 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.303208 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.303435 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.303435 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.303796 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.303796 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.304071 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.304071 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.304217 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.304307 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.304399 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.304500 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.304584 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.304584 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.304731 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.304731 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.304888 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.304972 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.305062 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.305153 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.305243 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.305326 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.305421 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.305505 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.305576 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.305665 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.305748 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.305838 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.305918 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.305990 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.306060 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.306138 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.306214 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.306298 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.306369 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.306439 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.306508 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.306576 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.306651 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.306734 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.307008 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.307114 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.307208 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.307291 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.307381 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.307473 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.307564 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.307667 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.307774 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.307860 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.307955 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.308049 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.308140 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.308372 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.308465 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.308549 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.308631 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.308715 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.308805 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.308895 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.308985 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.309074 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.309169 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.309169 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.309330 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.309419 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.309509 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.309599 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.309690 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.309774 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.309856 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.309937 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.310016 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.310105 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.310185 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.310264 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.310335 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.310405 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.310482 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.310571 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.310643 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.310726 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.310815 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.310898 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.310980 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.311070 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.311153 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.311243 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.311372 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.311470 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.311470 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.311633 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.311717 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.311829 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.311914 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.312002 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.312090 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.312181 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.312264 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.312346 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.312434 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.312529 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.312612 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.312700 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.312789 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.312872 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.313005 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.313090 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.313171 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.313252 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.313333 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.313422 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.313514 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.313593 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.313663 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.313750 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.313832 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.313912 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.313990 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.314061 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.314130 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.314199 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.314266 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.314343 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.314413 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.314491 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.314562 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.314752 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.314853 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.315064 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.315158 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.315376 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.315476 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.315691 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.315813 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.316030 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.316122 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.316343 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.316433 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.316654 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.316752 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.316969 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.317090 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.317298 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.317414 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.317615 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.317722 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.317932 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.318086 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.318232 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.318418 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.318574 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.318858 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.318858 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.319146 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.319294 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.319431 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.319575 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.319723 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.319849 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.319950 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.320144 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.320243 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.320462 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.320566 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.320783 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.320874 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.321093 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.321182 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.321405 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.321503 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.321734 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.321824 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.322052 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.322142 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.322367 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.322457 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.322687 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.322785 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.322999 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.323091 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.323318 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.323409 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.323630 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.323727 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.323974 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.324074 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.324333 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.324438 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.324596 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.324688 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.324908 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.325008 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.325218 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.325307 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.325532 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.325629 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.325846 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.326049 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.326162 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.326261 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.326472 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.326570 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.326784 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.326885 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.327102 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.327222 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.327408 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.327510 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.327722 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.327849 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.328062 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.328182 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.328386 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.328491 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.328703 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.328857 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.329015 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.329167 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.329306 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.329444 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.329616 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.329756 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.329933 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.330076 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.330243 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.330387 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.330691 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.331012 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.331112 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.331331 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.331423 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.331644 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.331775 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.331995 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.332087 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.332318 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.332409 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.332646 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.332745 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.332973 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.333063 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.333292 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.333382 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.333630 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.333730 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.333962 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.334064 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.334281 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.334551 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.334708 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.334845 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.334991 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.335127 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.335272 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.335945 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.336091 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.336192 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.336421 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.336512 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.336732 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.336830 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.337045 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.337151 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.337383 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.337480 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.337657 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.337762 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.337969 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.338066 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.338296 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.338395 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.338622 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.338723 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.338940 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.339060 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.339254 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.339353 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.339568 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.339734 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.339952 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.340079 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.340269 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.340401 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.340641 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.340742 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.340962 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.341054 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.341287 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.341386 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.341619 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.341719 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.341940 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.342032 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.342261 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.342359 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.342585 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.342684 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.343380 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.343508 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.343508 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.343673 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.343850 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.343947 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.344038 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.344122 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.344210 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.344304 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.344550 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.344650 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.344784 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.344903 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.345105 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.345206 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.345425 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.345516 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.345757 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.345848 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.346087 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.346187 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.346421 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.346512 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.346734 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.346825 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.347052 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.347162 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.347363 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.347457 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.347678 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.347789 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.348019 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.348111 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.348337 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.348448 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.348658 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.348755 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.348969 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.349078 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.349282 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.349378 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.349596 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.349692 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.349912 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.350010 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.350477 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.350587 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.350791 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.350889 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.351665 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.351856 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.351997 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.352138 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.352332 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.352472 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.352653 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.352796 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.352967 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.353129 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.353286 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.353459 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.353602 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.353774 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.353923 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.354106 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.354237 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.354431 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.354699 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.354800 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.355015 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.355116 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.355337 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.355438 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.355653 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.355787 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.356038 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.356157 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.356332 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.356424 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.356657 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.356755 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.356987 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.357125 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.357303 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.357386 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.357712 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.357816 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.358026 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.358122 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.358358 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.358460 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.358681 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.358787 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.358991 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.359092 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.359314 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.359422 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.359637 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.359730 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.359997 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.360102 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.360322 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.360410 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.360633 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.360730 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.360943 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.361040 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.361253 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.361349 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.361572 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.361663 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.361884 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.361981 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.362195 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.362318 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.362519 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.362641 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.362858 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.362957 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.363170 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.363382 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.363501 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.363705 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.363870 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.364053 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.364167 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.364442 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.364556 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.364802 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.364954 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.365064 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.365148 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.365384 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.365515 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.365769 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.365851 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.366110 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.366229 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.366564 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.366844 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.367429 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.367844 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.368113 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.368218 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.368305 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.368399 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.368540 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.368741 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.368901 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.368984 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.369098 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.369201 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.369275 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.369358 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.369444 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.369517 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.369725 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.369965 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.370067 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.370368 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.370470 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.370692 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.370942 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.371038 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.371283 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.371385 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.371606 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.371698 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.371955 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.372054 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.372276 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.372375 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.372599 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.372698 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.372913 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.373004 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.373231 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.373321 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.373551 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.373653 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.373865 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.373991 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.374184 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.374273 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.374505 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.374605 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.374823 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.375011 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.375169 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.375351 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.375506 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.375675 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.375856 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.375952 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.376094 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.376187 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.376422 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.376521 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.376753 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.376851 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.377084 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.377173 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.377399 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.377498 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.377731 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.377886 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.378055 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.378219 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.378374 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.378516 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.378731 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.378904 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.379040 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.379192 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.379331 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.379469 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.379585 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.379805 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.379942 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.380134 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.380271 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.380410 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.380556 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.380712 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.380849 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.380995 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.381137 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.381280 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.381449 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.381553 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.381792 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.381899 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.382120 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.382218 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.382468 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.382558 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.382794 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.382886 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.383120 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.383211 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.383432 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.383650 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.384001 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.384106 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.384341 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.384438 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.384657 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.384749 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.384975 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.385133 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.385286 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.385426 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.385588 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.385738 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.385888 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.386043 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.386189 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.386325 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.386514 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.386663 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.386810 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.386959 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.387142 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.387283 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.387455 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.387698 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.387863 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.387956 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.388122 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.388274 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.388434 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.388585 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.388749 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.388884 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.389066 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.389233 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.389573 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.389716 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.389894 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.390049 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.390228 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.390362 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.390553 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.390693 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.390874 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.391015 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.391199 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.391355 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.391523 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.391670 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.391871 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.391977 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.392195 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.392287 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.392507 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.392598 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.392823 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.392920 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.393140 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.393238 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.393455 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.393553 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.393769 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.393861 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.394091 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.394324 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.394423 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.394662 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.394762 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.395071 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.395179 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.395366 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.395453 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.395619 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.395816 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.395966 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.396072 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.396285 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.396385 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.396602 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.396703 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.396922 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.397022 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.397237 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.397335 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.397552 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.397651 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.397867 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.398500 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.398707 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.398828 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.399034 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.399201 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.399351 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.399503 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.399778 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.399950 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.400105 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.400253 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.400405 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.400548 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.400745 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.400837 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.401067 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.401157 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.401383 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.401476 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.401714 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.401804 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.402027 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.402117 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.402340 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.402439 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.402660 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.402750 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.402978 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.403080 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.403377 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.403626 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.403731 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.403836 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.403981 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.404091 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.404271 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.404371 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.404590 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.404691 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.404950 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.405144 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.405313 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.405639 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.405820 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.406007 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.406126 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.406353 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.406445 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.406711 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.406806 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.407015 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.407127 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.407332 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.407431 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.407646 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.407882 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.408009 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.408207 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.408300 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.408575 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.408673 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.408914 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.409018 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.409237 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.409329 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.409556 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.409655 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.409874 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.409988 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.410197 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.410300 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.410510 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.410600 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.410825 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.410925 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.411161 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.411275 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.411462 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.411598 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.411794 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.411905 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.412116 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.412207 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.412433 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.412533 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.412746 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.412836 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.413075 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.413173 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.413394 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.413484 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.414289 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.414491 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.414616 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.414859 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.414959 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.415193 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.415311 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.415538 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.415640 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.415886 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.415992 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.416209 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.416360 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.416527 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.416616 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.416860 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.416957 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.417179 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.417270 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.417492 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.417586 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.417818 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.417915 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.418142 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.418242 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.418461 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.418560 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.418781 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.418906 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.419112 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.419304 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.419478 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.419621 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.419797 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.419951 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.420095 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.420261 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.420406 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.420588 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.420726 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.420999 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.421141 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.421318 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.421472 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.421636 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.421837 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.421949 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.422213 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.422394 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.422557 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.422696 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.422866 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.423020 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.423181 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.423329 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.423492 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.423645 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.423831 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.423922 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.424170 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.424276 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.424492 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.424591 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.424805 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.424921 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.425140 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.425242 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.425463 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.425595 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.425781 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.425892 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.426092 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.426184 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.426405 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.426505 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.426719 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.426811 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.427035 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.427125 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.427348 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.427448 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.427660 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.427825 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.427999 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.428090 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.428312 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.428420 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.428627 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.428731 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.428940 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.429037 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.429278 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.429538 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.429645 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.429885 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.429976 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.430193 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.430279 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.430506 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.430605 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.430819 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.430918 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.431157 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.431263 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.431471 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.431567 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.431827 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.431924 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.432140 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.432249 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.432463 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.432562 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.432825 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.432924 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.433108 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.433208 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.433431 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.433522 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.433752 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.433842 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.434073 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.434163 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.434389 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.434485 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.434710 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.434808 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.435026 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.435117 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.435343 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.435458 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.435663 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.435798 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.436007 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.436157 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.436323 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.436420 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.436638 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.436737 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.436959 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.437059 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.437288 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.437389 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.437604 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.437709 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.437934 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.438031 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.438257 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.438362 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.438581 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.438680 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.438901 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.438987 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.439218 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.439356 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.439532 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.439635 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.439878 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.439973 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.440194 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.440298 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.440512 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.440619 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.440829 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.440927 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.441141 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.441238 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.441458 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.441576 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.441778 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.441896 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.442095 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.442200 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.442418 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.442521 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.442740 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.442830 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.443073 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.443173 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.443405 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.443494 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.443722 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.443868 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.444080 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.444187 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.444398 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.444497 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.444738 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.444849 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.445083 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.445188 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.445433 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.445530 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.445835 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.445991 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.446092 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.446282 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.446421 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.446579 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.446708 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.446841 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.446992 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 28 09:44:41.447130 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.447292 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.447614 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.447954 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.448269 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.448590 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.448908 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.449222 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.449534 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.449847 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.450168 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.450479 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.450795 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.451105 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.451419 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.451730 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.452063 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.452380 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.452692 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.453005 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.453318 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.453630 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.453942 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.454281 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.454623 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.454947 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.455278 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.455597 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.455954 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.456271 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.456598 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.456931 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.457254 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.457572 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.457915 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.458236 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.458557 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.458876 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.459197 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.459513 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.459853 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.460193 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.461353 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.461858 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.462208 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.462541 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.462874 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.463205 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.463528 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.463892 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.464217 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.464549 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.464860 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.465189 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.465508 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.465826 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.466129 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.466454 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.466777 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.467105 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.467439 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.467796 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.468121 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.468457 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.468791 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.469149 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.469474 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.469829 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.470166 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.470487 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.470810 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.471126 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:44:41.471373 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 28 09:44:41.509365 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO dbcounter [None req-59aab38d-b20f-4d0f-9ea8-efcaec4e8a35 None None] Registered counter for database nova_api Oct 28 09:44:41.530993 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_db.sqlalchemy.engines [None req-59aab38d-b20f-4d0f-9ea8-efcaec4e8a35 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127032) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 28 09:44:41.533866 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO dbcounter [None req-5deeaf2d-9620-461a-ae90-846c37ce142a None None] Registered counter for database nova_api Oct 28 09:44:41.537656 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG dbcounter [-] [127032] Writer thread running {{(pid=127032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 28 09:44:41.554674 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_db.sqlalchemy.engines [None req-5deeaf2d-9620-461a-ae90-846c37ce142a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127033) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 28 09:44:41.561341 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG dbcounter [-] [127033] Writer thread running {{(pid=127033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 28 09:44:41.596108 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.context [None req-59aab38d-b20f-4d0f-9ea8-efcaec4e8a35 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2b15302a-f4a0-4e7f-8af3-7ee6eb916adf(cell1) {{(pid=127032) load_cells /opt/stack/nova/nova/context.py:464}} Oct 28 09:44:41.600357 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-59aab38d-b20f-4d0f-9ea8-efcaec4e8a35 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:44:41.600848 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-59aab38d-b20f-4d0f-9ea8-efcaec4e8a35 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:44:41.602499 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-59aab38d-b20f-4d0f-9ea8-efcaec4e8a35 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:44:41.603236 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-59aab38d-b20f-4d0f-9ea8-efcaec4e8a35 None None] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:44:41.603687 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-59aab38d-b20f-4d0f-9ea8-efcaec4e8a35 None None] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:44:41.605690 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-59aab38d-b20f-4d0f-9ea8-efcaec4e8a35 None None] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:44:41.607698 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO dbcounter [None req-59aab38d-b20f-4d0f-9ea8-efcaec4e8a35 None None] Registered counter for database nova_cell0 Oct 28 09:44:41.611891 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO dbcounter [None req-59aab38d-b20f-4d0f-9ea8-efcaec4e8a35 None None] Registered counter for database nova_cell1 Oct 28 09:44:41.619307 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_db.sqlalchemy.engines [None req-59aab38d-b20f-4d0f-9ea8-efcaec4e8a35 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127032) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 28 09:44:41.619691 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.context [None req-5deeaf2d-9620-461a-ae90-846c37ce142a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2b15302a-f4a0-4e7f-8af3-7ee6eb916adf(cell1) {{(pid=127033) load_cells /opt/stack/nova/nova/context.py:464}} Oct 28 09:44:41.621094 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_db.sqlalchemy.engines [None req-59aab38d-b20f-4d0f-9ea8-efcaec4e8a35 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127032) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 28 09:44:41.623627 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-5deeaf2d-9620-461a-ae90-846c37ce142a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:44:41.624270 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-5deeaf2d-9620-461a-ae90-846c37ce142a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:44:41.625864 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-5deeaf2d-9620-461a-ae90-846c37ce142a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:44:41.626606 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-5deeaf2d-9620-461a-ae90-846c37ce142a None None] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:44:41.626728 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG dbcounter [-] [127032] Writer thread running {{(pid=127032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 28 09:44:41.627062 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-5deeaf2d-9620-461a-ae90-846c37ce142a None None] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:44:41.629089 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-5deeaf2d-9620-461a-ae90-846c37ce142a None None] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:44:41.629426 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG dbcounter [-] [127032] Writer thread running {{(pid=127032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 28 09:44:41.631092 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO dbcounter [None req-5deeaf2d-9620-461a-ae90-846c37ce142a None None] Registered counter for database nova_cell0 Oct 28 09:44:41.635793 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO dbcounter [None req-5deeaf2d-9620-461a-ae90-846c37ce142a None None] Registered counter for database nova_cell1 Oct 28 09:44:41.644535 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_db.sqlalchemy.engines [None req-5deeaf2d-9620-461a-ae90-846c37ce142a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127033) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 28 09:44:41.646743 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_db.sqlalchemy.engines [None req-5deeaf2d-9620-461a-ae90-846c37ce142a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127033) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 28 09:44:41.652504 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG dbcounter [-] [127033] Writer thread running {{(pid=127033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 28 09:44:41.657779 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG dbcounter [-] [127033] Writer thread running {{(pid=127033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 28 09:44:41.781543 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO dbcounter [None req-59aab38d-b20f-4d0f-9ea8-efcaec4e8a35 None None] Registered counter for database nova_cell0 Oct 28 09:44:41.792536 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_db.sqlalchemy.engines [None req-59aab38d-b20f-4d0f-9ea8-efcaec4e8a35 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127032) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 28 09:44:41.797958 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG dbcounter [-] [127032] Writer thread running {{(pid=127032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 28 09:44:41.804177 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO dbcounter [None req-5deeaf2d-9620-461a-ae90-846c37ce142a None None] Registered counter for database nova_cell0 Oct 28 09:44:41.811094 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_db.sqlalchemy.engines [None req-5deeaf2d-9620-461a-ae90-846c37ce142a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127033) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 28 09:44:41.816073 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG dbcounter [-] [127033] Writer thread running {{(pid=127033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 28 09:44:42.121657 dv-cinder-zed-3-smb devstack@n-api.service[127032]: WARNING keystonemiddleware.auth_token [None req-59aab38d-b20f-4d0f-9ea8-efcaec4e8a35 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 28 09:44:42.129085 dv-cinder-zed-3-smb devstack@n-api.service[127032]: WARNING keystonemiddleware.auth_token [None req-59aab38d-b20f-4d0f-9ea8-efcaec4e8a35 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 28 09:44:42.145368 dv-cinder-zed-3-smb devstack@n-api.service[127033]: WARNING keystonemiddleware.auth_token [None req-5deeaf2d-9620-461a-ae90-846c37ce142a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 28 09:44:42.152854 dv-cinder-zed-3-smb devstack@n-api.service[127033]: WARNING keystonemiddleware.auth_token [None req-5deeaf2d-9620-461a-ae90-846c37ce142a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 28 09:44:42.481490 dv-cinder-zed-3-smb devstack@n-api.service[127032]: WARNING keystonemiddleware.auth_token [None req-59aab38d-b20f-4d0f-9ea8-efcaec4e8a35 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 28 09:44:42.487592 dv-cinder-zed-3-smb devstack@n-api.service[127032]: WARNING keystonemiddleware.auth_token [None req-59aab38d-b20f-4d0f-9ea8-efcaec4e8a35 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 28 09:44:42.493714 dv-cinder-zed-3-smb devstack@n-api.service[127032]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55752faaa9c0 pid: 127032 (default app) Oct 28 09:44:42.501553 dv-cinder-zed-3-smb devstack@n-api.service[127033]: WARNING keystonemiddleware.auth_token [None req-5deeaf2d-9620-461a-ae90-846c37ce142a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 28 09:44:42.507682 dv-cinder-zed-3-smb devstack@n-api.service[127033]: WARNING keystonemiddleware.auth_token [None req-5deeaf2d-9620-461a-ae90-846c37ce142a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 28 09:44:42.513043 dv-cinder-zed-3-smb devstack@n-api.service[127033]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55752faaa9c0 pid: 127033 (default app) Oct 28 09:45:20.460359 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG dbcounter [-] [127032] Writing DB stats nova_api:SELECT=3 {{(pid=127032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:45:20.461433 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG dbcounter [-] [127032] Writing DB stats nova_cell0:SELECT=3 {{(pid=127032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:45:20.462538 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG dbcounter [-] [127032] Writing DB stats nova_cell1:SELECT=3 {{(pid=127032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:45:20.463468 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG dbcounter [-] [127032] Writing DB stats nova_cell0:SELECT=3 {{(pid=127032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:45:20.755797 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-b484ce9a-a928-4374-9c05-2802487d5d6a tempest-VolumesTestJSON-659549805 tempest-VolumesTestJSON-659549805-project] Calling method '.version_select at 0x7ff0112d3f70>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:45:20.783401 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG dbcounter [-] [127033] Writing DB stats nova_api:SELECT=3 {{(pid=127033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:45:20.784269 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG dbcounter [-] [127033] Writing DB stats nova_cell0:SELECT=3 {{(pid=127033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:45:20.785161 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG dbcounter [-] [127033] Writing DB stats nova_cell1:SELECT=3 {{(pid=127033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:45:20.790392 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG dbcounter [-] [127033] Writing DB stats nova_cell0:SELECT=3 {{(pid=127033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:45:21.688498 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-b27960be-9f96-4b9d-8c7b-3b34d08a058d tempest-VolumesGetTestJSON-565507007 tempest-VolumesGetTestJSON-565507007-project] Action: 'create', calling method: .version_select at 0x7ff0112273a0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1562832522", "metadata": {"Type": "work"}}} {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:45:22.629587 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-b484ce9a-a928-4374-9c05-2802487d5d6a tempest-VolumesTestJSON-659549805 tempest-VolumesTestJSON-659549805-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/1199ca8c-f461-48c8-9cc4-c0c740e2b433" status: 200 len: 351 microversion: 2.1 time: 2.086981 Oct 28 09:45:22.638453 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 1/1] 10.222.0.52 () {58 vars in 1245 bytes} [Fri Oct 28 09:45:20 2022] GET /compute/v2.1/os-volumes/1199ca8c-f461-48c8-9cc4-c0c740e2b433 => generated 351 bytes in 2089 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:45:23.840429 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-b27960be-9f96-4b9d-8c7b-3b34d08a058d tempest-VolumesGetTestJSON-565507007 tempest-VolumesGetTestJSON-565507007-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 3.398550 Oct 28 09:45:23.841932 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 1/2] 10.222.0.52 () {60 vars in 1156 bytes} [Fri Oct 28 09:45:20 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 3402 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 28 09:45:23.861171 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-595dea9c-8a17-4375-8060-d126673d3be6 tempest-VolumesGetTestJSON-565507007 tempest-VolumesGetTestJSON-565507007-project] Calling method '.version_select at 0x7ff0110e9280>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:45:24.489513 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-595dea9c-8a17-4375-8060-d126673d3be6 tempest-VolumesGetTestJSON-565507007 tempest-VolumesGetTestJSON-565507007-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/2d9772ba-e123-4e57-be23-17d788c7e297" status: 200 len: 354 microversion: 2.1 time: 0.632700 Oct 28 09:45:24.498854 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 2/3] 10.222.0.52 () {58 vars in 1245 bytes} [Fri Oct 28 09:45:23 2022] GET /compute/v2.1/os-volumes/2d9772ba-e123-4e57-be23-17d788c7e297 => generated 354 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:45:24.509160 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-4fa272fe-5dc2-4810-bbfe-4c16015ba567 tempest-VolumesGetTestJSON-565507007 tempest-VolumesGetTestJSON-565507007-project] Calling method '.version_select at 0x7ff01110b280>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:45:24.744492 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-4fa272fe-5dc2-4810-bbfe-4c16015ba567 tempest-VolumesGetTestJSON-565507007 tempest-VolumesGetTestJSON-565507007-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/2d9772ba-e123-4e57-be23-17d788c7e297" status: 200 len: 354 microversion: 2.1 time: 0.243923 Oct 28 09:45:24.746844 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 2/4] 10.222.0.52 () {58 vars in 1245 bytes} [Fri Oct 28 09:45:24 2022] GET /compute/v2.1/os-volumes/2d9772ba-e123-4e57-be23-17d788c7e297 => generated 354 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:45:24.765975 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-5a34ec72-e754-4835-b71e-c6a5e098dfd8 tempest-VolumesGetTestJSON-565507007 tempest-VolumesGetTestJSON-565507007-project] Calling method '.version_select at 0x7ff0110e9310>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:45:25.764350 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-91c6389a-72ca-416d-8fa4-3340b3221fd5 tempest-VolumesTestJSON-659549805 tempest-VolumesTestJSON-659549805-project] Calling method '.version_select at 0x7ff01110b940>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:45:25.925276 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-5a34ec72-e754-4835-b71e-c6a5e098dfd8 tempest-VolumesGetTestJSON-565507007 tempest-VolumesGetTestJSON-565507007-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/2d9772ba-e123-4e57-be23-17d788c7e297" status: 202 len: 0 microversion: 2.1 time: 1.163940 Oct 28 09:45:25.926541 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 3/5] 10.222.0.52 () {58 vars in 1248 bytes} [Fri Oct 28 09:45:24 2022] DELETE /compute/v2.1/os-volumes/2d9772ba-e123-4e57-be23-17d788c7e297 => generated 0 bytes in 1166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 09:45:25.936522 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-bc9494fb-0225-4f1d-ae86-2fcbb9a4c7cc tempest-VolumesGetTestJSON-565507007 tempest-VolumesGetTestJSON-565507007-project] Calling method '.version_select at 0x7ff0110e9a60>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:45:26.107293 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-91c6389a-72ca-416d-8fa4-3340b3221fd5 tempest-VolumesTestJSON-659549805 tempest-VolumesTestJSON-659549805-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/c6ad3b3a-eee2-4362-ad64-ca8db614d5c8" status: 200 len: 351 microversion: 2.1 time: 0.348686 Oct 28 09:45:26.108575 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 3/6] 10.222.0.52 () {58 vars in 1245 bytes} [Fri Oct 28 09:45:25 2022] GET /compute/v2.1/os-volumes/c6ad3b3a-eee2-4362-ad64-ca8db614d5c8 => generated 351 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 09:45:26.932532 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.wsgi [None req-bc9494fb-0225-4f1d-ae86-2fcbb9a4c7cc tempest-VolumesGetTestJSON-565507007 tempest-VolumesGetTestJSON-565507007-project] HTTP exception thrown: Volume 2d9772ba-e123-4e57-be23-17d788c7e297 could not be found. Oct 28 09:45:26.940477 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-bc9494fb-0225-4f1d-ae86-2fcbb9a4c7cc tempest-VolumesGetTestJSON-565507007 tempest-VolumesGetTestJSON-565507007-project] Request method failure captured: Oct 28 09:45:26.940477 dv-cinder-zed-3-smb devstack@n-api.service[127033]: request: GET /compute/v2.1/os-volumes/2d9772ba-e123-4e57-be23-17d788c7e297 HTTP/1.1 Oct 28 09:45:26.940477 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Accept: application/json Oct 28 09:45:26.940477 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Accept-Encoding: identity Oct 28 09:45:26.940477 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Connection: close Oct 28 09:45:26.940477 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Content-Length: 0 Oct 28 09:45:26.940477 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Content-Type: application/json Oct 28 09:45:26.940477 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Host: 10.222.0.52 Oct 28 09:45:26.940477 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Openstack-System-Scope: None Oct 28 09:45:26.940477 dv-cinder-zed-3-smb devstack@n-api.service[127033]: User-Agent: python-urllib3/1.26.12 Oct 28 09:45:26.940477 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Auth-Token: gAAAAABjW6SwmhzUwqxA_iNGLTzPNYWo6WV60ABSWiwJ2VfomgmwS68VYQSsfkrT0ME7MHzPUDiUlO6sYevCsUvvo7_sHUGJuHIW3aPcl7iuNnbIU5sgCQCaMM2ExNYG2YwQc9dtIpyKfe5z91MwqKKe17myOnvRmBKRfdzJbFWy2mvmick2jNA Oct 28 09:45:26.940477 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Domain-Id: None Oct 28 09:45:26.940477 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Domain-Name: None Oct 28 09:45:26.940477 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Identity-Status: Confirmed Oct 28 09:45:26.940477 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Is-Admin-Project: True Oct 28 09:45:26.940477 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Project-Domain-Id: default Oct 28 09:45:26.940477 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Project-Domain-Name: Default Oct 28 09:45:26.940477 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Project-Id: 7bf643c5c7aa47468b2796ef67ad5321 Oct 28 09:45:26.940477 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Project-Name: tempest-VolumesGetTestJSON-565507007 Oct 28 09:45:26.940477 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Role: reader,member Oct 28 09:45:26.940477 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Roles: reader,member Oct 28 09:45:26.941857 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7bf643c5c7aa47468b2796ef67ad5321"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7bf643c5c7aa47468b2796ef67ad5321"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7bf643c5c7aa47468b2796ef67ad5321"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7bf643c5c7aa47468b2796ef67ad5321"}]}] Oct 28 09:45:26.941857 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Tenant: tempest-VolumesGetTestJSON-565507007 Oct 28 09:45:26.941857 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Tenant-Id: 7bf643c5c7aa47468b2796ef67ad5321 Oct 28 09:45:26.941857 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Tenant-Name: tempest-VolumesGetTestJSON-565507007 Oct 28 09:45:26.941857 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User: tempest-VolumesGetTestJSON-565507007-project Oct 28 09:45:26.941857 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User-Domain-Id: default Oct 28 09:45:26.941857 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User-Domain-Name: Default Oct 28 09:45:26.941857 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User-Id: f06db17158464566aae64758ef09edba Oct 28 09:45:26.941857 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User-Name: tempest-VolumesGetTestJSON-565507007-project Oct 28 09:45:26.941857 dv-cinder-zed-3-smb devstack@n-api.service[127033]: method: Oct 28 09:45:26.941857 dv-cinder-zed-3-smb devstack@n-api.service[127033]: exception: Volume 2d9772ba-e123-4e57-be23-17d788c7e297 could not be found. Oct 28 09:45:26.941857 dv-cinder-zed-3-smb devstack@n-api.service[127033]: action_args: {'id': '2d9772ba-e123-4e57-be23-17d788c7e297'} Oct 28 09:45:26.941857 dv-cinder-zed-3-smb devstack@n-api.service[127033]: {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:45:26.942641 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:45:26.942641 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 28 09:45:26.942641 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 28 09:45:26.942641 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 28 09:45:26.942641 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 28 09:45:26.942641 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 28 09:45:26.942641 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 28 09:45:26.942641 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 28 09:45:26.942641 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 28 09:45:26.942641 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 28 09:45:26.942641 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 28 09:45:26.942641 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 28 09:45:26.942641 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 28 09:45:26.942641 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 28 09:45:26.942641 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 28 09:45:26.942641 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2d9772ba-e123-4e57-be23-17d788c7e297 could not be found. (HTTP 404) (Request-ID: req-9b7fecf9-93d2-443d-9c80-e427020f9722) Oct 28 09:45:26.942641 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:45:26.942641 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:45:26.942641 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:45:26.943728 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:45:26.943728 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 28 09:45:26.943728 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 28 09:45:26.943728 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 28 09:45:26.943728 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 28 09:45:26.943728 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 28 09:45:26.943728 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 28 09:45:26.943728 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 28 09:45:26.943728 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 28 09:45:26.943728 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 28 09:45:26.943728 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 28 09:45:26.943728 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 28 09:45:26.943728 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 28 09:45:26.943728 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 28 09:45:26.943728 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 28 09:45:26.943728 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 28 09:45:26.943728 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 28 09:45:26.943728 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 28 09:45:26.943728 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 28 09:45:26.945268 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 28 09:45:26.945268 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 28 09:45:26.945268 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 28 09:45:26.945268 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 28 09:45:26.945268 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2d9772ba-e123-4e57-be23-17d788c7e297 could not be found. Oct 28 09:45:26.945268 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:45:26.945268 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:45:26.945268 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:45:26.945268 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:45:26.945268 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:45:26.945268 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:45:26.945268 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:45:26.945268 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:45:26.945268 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 09:45:26.945268 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 09:45:26.945268 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:45:26.945268 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:45:26.945268 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 28 09:45:26.945268 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 09:45:26.946292 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2d9772ba-e123-4e57-be23-17d788c7e297 could not be found. Oct 28 09:45:26.946292 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:45:26.946292 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:45:26.946292 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:45:26.946292 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:45:26.946292 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:45:26.946292 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:45:26.946292 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:45:26.946292 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:45:26.946292 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2d9772ba-e123-4e57-be23-17d788c7e297 could not be found. Oct 28 09:45:26.946292 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:45:26.946292 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-bc9494fb-0225-4f1d-ae86-2fcbb9a4c7cc tempest-VolumesGetTestJSON-565507007 tempest-VolumesGetTestJSON-565507007-project] Returning 404 to user: Volume 2d9772ba-e123-4e57-be23-17d788c7e297 could not be found. {{(pid=127033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:45:26.946292 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-bc9494fb-0225-4f1d-ae86-2fcbb9a4c7cc tempest-VolumesGetTestJSON-565507007 tempest-VolumesGetTestJSON-565507007-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/2d9772ba-e123-4e57-be23-17d788c7e297" status: 404 len: 109 microversion: 2.1 time: 1.014551 Oct 28 09:45:26.950682 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 4/7] 10.222.0.52 () {58 vars in 1245 bytes} [Fri Oct 28 09:45:25 2022] GET /compute/v2.1/os-volumes/2d9772ba-e123-4e57-be23-17d788c7e297 => generated 109 bytes in 1020 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 09:45:29.953450 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-6828e680-4478-4ba7-81ae-9f79e36b33de tempest-VolumesTestJSON-659549805 tempest-VolumesTestJSON-659549805-project] Calling method '.version_select at 0x7ff0110940d0>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:45:30.134352 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-6828e680-4478-4ba7-81ae-9f79e36b33de tempest-VolumesTestJSON-659549805 tempest-VolumesTestJSON-659549805-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/010883d0-8acf-4ebc-9898-453ad6dcf2a9" status: 200 len: 350 microversion: 2.1 time: 0.185310 Oct 28 09:45:30.135106 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 4/8] 10.222.0.52 () {58 vars in 1245 bytes} [Fri Oct 28 09:45:29 2022] GET /compute/v2.1/os-volumes/010883d0-8acf-4ebc-9898-453ad6dcf2a9 => generated 350 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:45:30.153569 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-b5aa4db7-0c04-4c6a-8862-32033d4ebf3c tempest-VolumesTestJSON-659549805 tempest-VolumesTestJSON-659549805-project] Calling method '.version_select at 0x7ff0110fda60>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:45:30.405251 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-b5aa4db7-0c04-4c6a-8862-32033d4ebf3c tempest-VolumesTestJSON-659549805 tempest-VolumesTestJSON-659549805-project] 10.222.0.52 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.258743 Oct 28 09:45:30.408112 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 5/9] 10.222.0.52 () {58 vars in 1134 bytes} [Fri Oct 28 09:45:30 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:45:30.426149 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-0e7b9e11-0493-49e2-a6cd-ddd5d4cd531d tempest-VolumesTestJSON-659549805 tempest-VolumesTestJSON-659549805-project] Calling method '.version_select at 0x7ff01110bca0>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:45:30.793111 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-0e7b9e11-0493-49e2-a6cd-ddd5d4cd531d tempest-VolumesTestJSON-659549805 tempest-VolumesTestJSON-659549805-project] 10.222.0.52 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.373193 Oct 28 09:45:30.796640 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 5/10] 10.222.0.52 () {58 vars in 1149 bytes} [Fri Oct 28 09:45:30 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 09:45:30.821397 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-520817ce-4b5f-496e-b9df-80fd9ef13580 tempest-VolumesTestJSON-659549805 tempest-VolumesTestJSON-659549805-project] Calling method '.version_select at 0x7ff0110fd790>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:45:31.034158 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-520817ce-4b5f-496e-b9df-80fd9ef13580 tempest-VolumesTestJSON-659549805 tempest-VolumesTestJSON-659549805-project] 10.222.0.52 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.223000 Oct 28 09:45:31.034158 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 6/11] 10.222.0.52 () {58 vars in 1134 bytes} [Fri Oct 28 09:45:30 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:45:31.057155 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-074597a7-a46a-4d99-a45a-3aa7c1579f63 tempest-VolumesTestJSON-659549805 tempest-VolumesTestJSON-659549805-project] Calling method '.version_select at 0x7ff0110944c0>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:45:31.465156 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-074597a7-a46a-4d99-a45a-3aa7c1579f63 tempest-VolumesTestJSON-659549805 tempest-VolumesTestJSON-659549805-project] 10.222.0.52 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.421252 Oct 28 09:45:31.466656 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 6/12] 10.222.0.52 () {58 vars in 1167 bytes} [Fri Oct 28 09:45:31 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:45:31.481472 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-cd40115e-5683-4816-876c-2b028a3711ba tempest-VolumesTestJSON-659549805 tempest-VolumesTestJSON-659549805-project] Calling method '.version_select at 0x7ff0110780d0>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:45:31.792440 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-cd40115e-5683-4816-876c-2b028a3711ba tempest-VolumesTestJSON-659549805 tempest-VolumesTestJSON-659549805-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.314835 Oct 28 09:45:31.812748 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 7/13] 10.222.0.52 () {58 vars in 1170 bytes} [Fri Oct 28 09:45:31 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:45:31.813464 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-0ccd4423-c0cf-43b9-8761-ac97bf593553 tempest-VolumesTestJSON-659549805 tempest-VolumesTestJSON-659549805-project] Calling method '.version_select at 0x7ff01110b040>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:45:32.130696 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-0ccd4423-c0cf-43b9-8761-ac97bf593553 tempest-VolumesTestJSON-659549805 tempest-VolumesTestJSON-659549805-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.326904 Oct 28 09:45:32.148267 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 7/14] 10.222.0.52 () {58 vars in 1155 bytes} [Fri Oct 28 09:45:31 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:45:32.149168 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-e5cad671-3725-460a-be84-c373b2243e0e tempest-VolumesTestJSON-659549805 tempest-VolumesTestJSON-659549805-project] Calling method '.version_select at 0x7ff011078940>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:45:32.399250 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-e5cad671-3725-460a-be84-c373b2243e0e tempest-VolumesTestJSON-659549805 tempest-VolumesTestJSON-659549805-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.256090 Oct 28 09:45:32.418111 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 8/15] 10.222.0.52 () {58 vars in 1188 bytes} [Fri Oct 28 09:45:32 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:45:32.419791 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-4dce0d8c-a000-4af1-aa48-7513d0296d6f tempest-VolumesTestJSON-659549805 tempest-VolumesTestJSON-659549805-project] Calling method '.version_select at 0x7ff0110949d0>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:45:32.617937 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-4dce0d8c-a000-4af1-aa48-7513d0296d6f tempest-VolumesTestJSON-659549805 tempest-VolumesTestJSON-659549805-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.205804 Oct 28 09:45:32.637424 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 8/16] 10.222.0.52 () {58 vars in 1155 bytes} [Fri Oct 28 09:45:32 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:45:33.013997 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-a0d172da-9ceb-4fa8-b840-2ef448bca862 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1822197362", "imageRef": "6e314146-a2ed-4f8b-afdd-4f7ed1184d20", "flavorRef": "452", "networks": [{"uuid": "1f4bbb19-f455-4f75-ad61-067b2704f9ae"}]}} {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:45:33.281732 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.network.neutron [None req-a0d172da-9ceb-4fa8-b840-2ef448bca862 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] validate_networks() for [('1f4bbb19-f455-4f75-ad61-067b2704f9ae', None, None, None, None, None)] {{(pid=127033) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 09:45:35.452360 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.virt.hardware [None req-a0d172da-9ceb-4fa8-b840-2ef448bca862 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Flavor limits 0:0:0 {{(pid=127033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 09:45:35.453076 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.virt.hardware [None req-a0d172da-9ceb-4fa8-b840-2ef448bca862 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Image limits 0:0:0 {{(pid=127033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 09:45:35.453281 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.virt.hardware [None req-a0d172da-9ceb-4fa8-b840-2ef448bca862 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Flavor pref 0:0:0 {{(pid=127033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 09:45:35.454095 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.virt.hardware [None req-a0d172da-9ceb-4fa8-b840-2ef448bca862 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Image pref 0:0:0 {{(pid=127033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 09:45:35.454535 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.virt.hardware [None req-a0d172da-9ceb-4fa8-b840-2ef448bca862 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 09:45:35.560687 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-a0d172da-9ceb-4fa8-b840-2ef448bca862 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:45:35.560687 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-a0d172da-9ceb-4fa8-b840-2ef448bca862 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:45:35.565574 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-a0d172da-9ceb-4fa8-b840-2ef448bca862 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:45:35.588765 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-a0d172da-9ceb-4fa8-b840-2ef448bca862 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:45:35.597282 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-a0d172da-9ceb-4fa8-b840-2ef448bca862 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:45:35.597745 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-a0d172da-9ceb-4fa8-b840-2ef448bca862 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:45:35.673129 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.quota [None req-a0d172da-9ceb-4fa8-b840-2ef448bca862 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Getting quotas for project 981def9b53d4448abde1baf030e5c63c. Resources: {'cores', 'ram', 'instances'} {{(pid=127033) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 09:45:35.693051 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.quota [None req-a0d172da-9ceb-4fa8-b840-2ef448bca862 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Getting quotas for user 5e01f518dbd947bfafa6aecdccd9cfd5 and project 981def9b53d4448abde1baf030e5c63c. Resources: {'cores', 'ram', 'instances'} {{(pid=127033) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 09:45:35.729614 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-a0d172da-9ceb-4fa8-b840-2ef448bca862 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Going to run 1 instances... {{(pid=127033) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 09:45:35.736910 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-a0d172da-9ceb-4fa8-b840-2ef448bca862 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] [instance: 0c61b6b7-811a-4c77-ab85-d6eb319dd22e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e314146-a2ed-4f8b-afdd-4f7ed1184d20',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127033) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 09:45:35.966410 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-a0d172da-9ceb-4fa8-b840-2ef448bca862 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.291345 Oct 28 09:45:35.974699 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 9/17] 10.222.0.52 () {60 vars in 1147 bytes} [Fri Oct 28 09:45:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 3300 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 28 09:45:35.986788 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-eb3560e2-c73c-4a05-85f7-ec1ee6391591 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:45:35.987540 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-eb3560e2-c73c-4a05-85f7-ec1ee6391591 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] [instance: 0c61b6b7-811a-4c77-ab85-d6eb319dd22e] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:45:36.283734 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-eb3560e2-c73c-4a05-85f7-ec1ee6391591 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e01f518dbd947bfafa6aecdccd9cfd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981def9b53d4448abde1baf030e5c63c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:45:36.320121 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-eb3560e2-c73c-4a05-85f7-ec1ee6391591 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] 10.222.0.52 "GET /compute/v2.1/servers/0c61b6b7-811a-4c77-ab85-d6eb319dd22e" status: 200 len: 1215 microversion: 2.1 time: 0.336725 Oct 28 09:45:36.322336 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 9/18] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:45:35 2022] GET /compute/v2.1/servers/0c61b6b7-811a-4c77-ab85-d6eb319dd22e => generated 1215 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:45:37.391939 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-614bca9d-4062-4e59-bb89-4cb739925287 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:45:37.402175 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-614bca9d-4062-4e59-bb89-4cb739925287 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] [instance: 0c61b6b7-811a-4c77-ab85-d6eb319dd22e] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:45:37.837112 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-614bca9d-4062-4e59-bb89-4cb739925287 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e01f518dbd947bfafa6aecdccd9cfd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981def9b53d4448abde1baf030e5c63c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:45:37.921739 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-614bca9d-4062-4e59-bb89-4cb739925287 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] 10.222.0.52 "GET /compute/v2.1/servers/0c61b6b7-811a-4c77-ab85-d6eb319dd22e" status: 200 len: 1215 microversion: 2.1 time: 0.552795 Oct 28 09:45:37.924007 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 10/19] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:45:37 2022] GET /compute/v2.1/servers/0c61b6b7-811a-4c77-ab85-d6eb319dd22e => generated 1215 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:45:38.950426 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-4d7fdfb2-2b87-4466-a567-846c41657f69 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:45:38.951289 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-4d7fdfb2-2b87-4466-a567-846c41657f69 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] [instance: 0c61b6b7-811a-4c77-ab85-d6eb319dd22e] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:45:38.995266 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-4d7fdfb2-2b87-4466-a567-846c41657f69 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:45:38.996342 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-4d7fdfb2-2b87-4466-a567-846c41657f69 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:45:38.997096 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-4d7fdfb2-2b87-4466-a567-846c41657f69 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:45:38.998546 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-4d7fdfb2-2b87-4466-a567-846c41657f69 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:45:38.999355 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-4d7fdfb2-2b87-4466-a567-846c41657f69 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:45:39.000185 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-4d7fdfb2-2b87-4466-a567-846c41657f69 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:45:39.904669 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-4d7fdfb2-2b87-4466-a567-846c41657f69 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e01f518dbd947bfafa6aecdccd9cfd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981def9b53d4448abde1baf030e5c63c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:45:39.956233 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-4d7fdfb2-2b87-4466-a567-846c41657f69 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] 10.222.0.52 "GET /compute/v2.1/servers/0c61b6b7-811a-4c77-ab85-d6eb319dd22e" status: 200 len: 1211 microversion: 2.1 time: 1.001335 Oct 28 09:45:39.958268 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 10/20] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:45:38 2022] GET /compute/v2.1/servers/0c61b6b7-811a-4c77-ab85-d6eb319dd22e => generated 1211 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:45:40.512390 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-ef5b18eb-3154-493b-9131-3ebc8480aa4d tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Action: 'create', calling method: .version_select at 0x7ff01077df70>, body: {"keypair": {"name": "tempest-keypair-501666664", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHqi+jsv1h8cejPQEoR/Ry6QuKgRx2Oa7ALj63Rn9lS41o2j+PH43qsRY/2+/76zcLZSSqHP/WuE+5LHQ1oivmEPYo6zvu41Q9tOjHdL3QY7Q8HE0ZL4tNzfXndVmW6oog=="}} {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:45:40.575451 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.quota [None req-ef5b18eb-3154-493b-9131-3ebc8480aa4d tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Getting quotas for project ae5e7d531c0f4a33a869309af965e3e5. Resources: {'key_pairs'} {{(pid=127033) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 09:45:40.593143 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.quota [None req-ef5b18eb-3154-493b-9131-3ebc8480aa4d tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Getting quotas for user 8bee2d5f599642788c32e0d8b8338c19 and project ae5e7d531c0f4a33a869309af965e3e5. Resources: {'key_pairs'} {{(pid=127033) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 09:45:40.727556 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-ef5b18eb-3154-493b-9131-3ebc8480aa4d tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.693476 Oct 28 09:45:40.731930 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 11/21] 10.222.0.52 () {60 vars in 1159 bytes} [Fri Oct 28 09:45:40 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:45:40.988613 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-fccf6dc1-41a7-4468-a938-6029193d1ad7 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:45:40.993336 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-fccf6dc1-41a7-4468-a938-6029193d1ad7 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] [instance: 0c61b6b7-811a-4c77-ab85-d6eb319dd22e] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:45:41.010806 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-fccf6dc1-41a7-4468-a938-6029193d1ad7 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:45:41.012181 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-fccf6dc1-41a7-4468-a938-6029193d1ad7 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:45:41.012181 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-fccf6dc1-41a7-4468-a938-6029193d1ad7 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:45:41.012893 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-fccf6dc1-41a7-4468-a938-6029193d1ad7 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:45:41.013210 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-fccf6dc1-41a7-4468-a938-6029193d1ad7 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:45:41.013634 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-fccf6dc1-41a7-4468-a938-6029193d1ad7 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:45:41.492457 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-fccf6dc1-41a7-4468-a938-6029193d1ad7 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e01f518dbd947bfafa6aecdccd9cfd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981def9b53d4448abde1baf030e5c63c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:45:41.504578 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-fccf6dc1-41a7-4468-a938-6029193d1ad7 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] 10.222.0.52 "GET /compute/v2.1/servers/0c61b6b7-811a-4c77-ab85-d6eb319dd22e" status: 200 len: 1273 microversion: 2.1 time: 0.521515 Oct 28 09:45:41.522982 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 11/22] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:45:40 2022] GET /compute/v2.1/servers/0c61b6b7-811a-4c77-ab85-d6eb319dd22e => generated 1273 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:45:42.557960 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-1e35498d-3223-464b-b400-5f901ab40422 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:45:42.566024 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-1e35498d-3223-464b-b400-5f901ab40422 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] [instance: 0c61b6b7-811a-4c77-ab85-d6eb319dd22e] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:45:42.599836 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-1e35498d-3223-464b-b400-5f901ab40422 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:45:42.601966 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-1e35498d-3223-464b-b400-5f901ab40422 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:45:42.613361 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-1e35498d-3223-464b-b400-5f901ab40422 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:45:42.617550 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-1e35498d-3223-464b-b400-5f901ab40422 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:45:42.618918 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-1e35498d-3223-464b-b400-5f901ab40422 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:45:42.620429 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-1e35498d-3223-464b-b400-5f901ab40422 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:45:43.628477 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-1e35498d-3223-464b-b400-5f901ab40422 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e01f518dbd947bfafa6aecdccd9cfd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981def9b53d4448abde1baf030e5c63c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:45:43.728052 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-1e35498d-3223-464b-b400-5f901ab40422 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] 10.222.0.52 "GET /compute/v2.1/servers/0c61b6b7-811a-4c77-ab85-d6eb319dd22e" status: 200 len: 1273 microversion: 2.1 time: 1.196865 Oct 28 09:45:43.733563 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 12/23] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:45:42 2022] GET /compute/v2.1/servers/0c61b6b7-811a-4c77-ab85-d6eb319dd22e => generated 1273 bytes in 1206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:45:44.762912 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-475c1a7b-642e-4379-9c06-58a250de527f tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:45:44.764485 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-475c1a7b-642e-4379-9c06-58a250de527f tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] [instance: 0c61b6b7-811a-4c77-ab85-d6eb319dd22e] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:45:44.805297 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-475c1a7b-642e-4379-9c06-58a250de527f tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:45:44.807294 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-475c1a7b-642e-4379-9c06-58a250de527f tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:45:44.814450 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-475c1a7b-642e-4379-9c06-58a250de527f tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:45:44.817291 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-475c1a7b-642e-4379-9c06-58a250de527f tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:45:44.825192 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-475c1a7b-642e-4379-9c06-58a250de527f tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:45:44.834080 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-475c1a7b-642e-4379-9c06-58a250de527f tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:45:46.320193 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG dbcounter [-] [127032] Writing DB stats nova_cell0:SELECT=2 {{(pid=127032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:45:47.765021 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG dbcounter [-] [127033] Writing DB stats nova_cell0:SELECT=2 {{(pid=127033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:45:48.047466 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-79b3b050-11bb-40d8-bb01-2c04cd33abf9 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Action: 'create', calling method: .version_select at 0x7ff010674160>, body: {"keypair": {"name": "tempest-keypair-280231662", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKroPTDf4lMw1VtUUlC35zAX6yXimQHlCaiIznlXBD+Xj7gTRuDPV04mKi12/04OluCPEhDrematKx3dNff0PxP22Y5KbGdOJ8YtQTz9k+WPpFEp4ENF85MlMxG1lTolJQ=="}} {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:45:48.108153 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.quota [None req-79b3b050-11bb-40d8-bb01-2c04cd33abf9 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Getting quotas for project 500be47836b44a769f676e3e4bc00721. Resources: {'key_pairs'} {{(pid=127033) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 09:45:48.126446 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.quota [None req-79b3b050-11bb-40d8-bb01-2c04cd33abf9 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Getting quotas for user cdb5ce192c764fe4946542f5960ccd39 and project 500be47836b44a769f676e3e4bc00721. Resources: {'key_pairs'} {{(pid=127033) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 09:45:48.219587 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-79b3b050-11bb-40d8-bb01-2c04cd33abf9 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.461516 Oct 28 09:45:48.222378 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 13/24] 10.222.0.52 () {62 vars in 1200 bytes} [Fri Oct 28 09:45:47 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 467 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 28 09:45:48.422022 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-475c1a7b-642e-4379-9c06-58a250de527f tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e01f518dbd947bfafa6aecdccd9cfd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981def9b53d4448abde1baf030e5c63c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:45:48.456782 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-475c1a7b-642e-4379-9c06-58a250de527f tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] 10.222.0.52 "GET /compute/v2.1/servers/0c61b6b7-811a-4c77-ab85-d6eb319dd22e" status: 200 len: 1315 microversion: 2.1 time: 3.699178 Oct 28 09:45:48.457729 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 12/25] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:45:44 2022] GET /compute/v2.1/servers/0c61b6b7-811a-4c77-ab85-d6eb319dd22e => generated 1315 bytes in 3701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:45:49.508217 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-0f266188-0561-4119-aca7-ad462ad868ab tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:45:49.517251 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-0f266188-0561-4119-aca7-ad462ad868ab tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] [instance: 0c61b6b7-811a-4c77-ab85-d6eb319dd22e] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:45:49.554708 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-0f266188-0561-4119-aca7-ad462ad868ab tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:45:49.565784 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-0f266188-0561-4119-aca7-ad462ad868ab tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:45:49.572912 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-0f266188-0561-4119-aca7-ad462ad868ab tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:45:49.582024 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-0f266188-0561-4119-aca7-ad462ad868ab tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:45:49.586540 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-0f266188-0561-4119-aca7-ad462ad868ab tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:45:49.587708 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-0f266188-0561-4119-aca7-ad462ad868ab tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:45:51.735187 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-0f266188-0561-4119-aca7-ad462ad868ab tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e01f518dbd947bfafa6aecdccd9cfd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981def9b53d4448abde1baf030e5c63c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:45:51.776167 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-0f266188-0561-4119-aca7-ad462ad868ab tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] 10.222.0.52 "GET /compute/v2.1/servers/0c61b6b7-811a-4c77-ab85-d6eb319dd22e" status: 200 len: 1315 microversion: 2.1 time: 2.268710 Oct 28 09:45:51.785024 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 14/26] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:45:49 2022] GET /compute/v2.1/servers/0c61b6b7-811a-4c77-ab85-d6eb319dd22e => generated 1315 bytes in 2281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:45:52.809420 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-d6271c6f-eb7a-469d-b8ce-ebf1d362e6cc tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:45:52.810362 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-d6271c6f-eb7a-469d-b8ce-ebf1d362e6cc tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] [instance: 0c61b6b7-811a-4c77-ab85-d6eb319dd22e] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:45:52.826663 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-d6271c6f-eb7a-469d-b8ce-ebf1d362e6cc tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:45:52.831856 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-d6271c6f-eb7a-469d-b8ce-ebf1d362e6cc tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:45:52.834049 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-d6271c6f-eb7a-469d-b8ce-ebf1d362e6cc tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:45:52.834795 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-d6271c6f-eb7a-469d-b8ce-ebf1d362e6cc tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:45:52.837448 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-d6271c6f-eb7a-469d-b8ce-ebf1d362e6cc tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:45:52.839250 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-d6271c6f-eb7a-469d-b8ce-ebf1d362e6cc tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:45:53.548794 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-edc163c8-881d-4ad2-9a97-e8de5c393972 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1283744436", "imageRef": "6e314146-a2ed-4f8b-afdd-4f7ed1184d20", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3e35dfd4-7f9d-4a28-8cf6-3cf4d8a0ceaa"}], "security_groups": [{"name": "tempest-securitygroup--976585509"}], "key_name": "tempest-keypair-501666664", "user_data": "}} {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:45:54.121813 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.network.neutron [None req-edc163c8-881d-4ad2-9a97-e8de5c393972 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] validate_networks() for [('3e35dfd4-7f9d-4a28-8cf6-3cf4d8a0ceaa', None, None, None, None, None)] {{(pid=127033) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 09:45:54.757831 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-d6271c6f-eb7a-469d-b8ce-ebf1d362e6cc tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e01f518dbd947bfafa6aecdccd9cfd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981def9b53d4448abde1baf030e5c63c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:45:54.766169 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-d6271c6f-eb7a-469d-b8ce-ebf1d362e6cc tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] 10.222.0.52 "GET /compute/v2.1/servers/0c61b6b7-811a-4c77-ab85-d6eb319dd22e" status: 200 len: 1315 microversion: 2.1 time: 1.963193 Oct 28 09:45:54.775016 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 13/27] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:45:52 2022] GET /compute/v2.1/servers/0c61b6b7-811a-4c77-ab85-d6eb319dd22e => generated 1315 bytes in 1973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:45:55.362235 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [req-e44aa5ae-ee37-4b45-811b-2442f0ba5cf9 req-74b788e3-59e1-4943-bb5e-2339e09920b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c61b6b7-811a-4c77-ab85-d6eb319dd22e", "tag": "9d73f353-d1c2-4f15-835d-d4a3b3feef41"}]} {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:45:55.429759 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-e44aa5ae-ee37-4b45-811b-2442f0ba5cf9 req-74b788e3-59e1-4943-bb5e-2339e09920b7 service nova] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:45:55.435938 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-e44aa5ae-ee37-4b45-811b-2442f0ba5cf9 req-74b788e3-59e1-4943-bb5e-2339e09920b7 service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:45:55.436389 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-e44aa5ae-ee37-4b45-811b-2442f0ba5cf9 req-74b788e3-59e1-4943-bb5e-2339e09920b7 service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:45:55.576898 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.compute.server_external_events [req-e44aa5ae-ee37-4b45-811b-2442f0ba5cf9 req-74b788e3-59e1-4943-bb5e-2339e09920b7 service nova] Creating event network-changed:9d73f353-d1c2-4f15-835d-d4a3b3feef41 for instance 0c61b6b7-811a-4c77-ab85-d6eb319dd22e on hv-cinder-zed-3 Oct 28 09:45:55.577438 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-e44aa5ae-ee37-4b45-811b-2442f0ba5cf9 req-74b788e3-59e1-4943-bb5e-2339e09920b7 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127032) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 28 09:45:55.581536 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-e44aa5ae-ee37-4b45-811b-2442f0ba5cf9 req-74b788e3-59e1-4943-bb5e-2339e09920b7 service nova] Acquired lock "compute-rpcapi-router" {{(pid=127032) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 28 09:45:55.582992 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ef21cc9b-df49-44d3-867a-274042cd33ea None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:45:55.588513 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ef21cc9b-df49-44d3-867a-274042cd33ea None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:45:55.594409 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ef21cc9b-df49-44d3-867a-274042cd33ea None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:45:55.601992 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ef21cc9b-df49-44d3-867a-274042cd33ea None None] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:45:55.603230 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ef21cc9b-df49-44d3-867a-274042cd33ea None None] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:45:55.607149 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ef21cc9b-df49-44d3-867a-274042cd33ea None None] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:45:55.648395 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.compute.rpcapi [None req-ef21cc9b-df49-44d3-867a-274042cd33ea None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 28 09:45:55.654756 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ef21cc9b-df49-44d3-867a-274042cd33ea None None] Releasing lock "compute-rpcapi-router" {{(pid=127032) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 28 09:45:55.731261 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-ef21cc9b-df49-44d3-867a-274042cd33ea None None] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.954848 Oct 28 09:45:55.732380 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 14/28] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Oct 28 09:45:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:45:55.796345 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-cf68d180-f62f-4ad4-86ee-099f56ebb926 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:45:55.797299 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-cf68d180-f62f-4ad4-86ee-099f56ebb926 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] [instance: 0c61b6b7-811a-4c77-ab85-d6eb319dd22e] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:45:55.817380 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-cf68d180-f62f-4ad4-86ee-099f56ebb926 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:45:55.820581 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-cf68d180-f62f-4ad4-86ee-099f56ebb926 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:45:55.823666 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-cf68d180-f62f-4ad4-86ee-099f56ebb926 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:45:55.829324 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-cf68d180-f62f-4ad4-86ee-099f56ebb926 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:45:55.830764 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-cf68d180-f62f-4ad4-86ee-099f56ebb926 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:45:55.832603 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-cf68d180-f62f-4ad4-86ee-099f56ebb926 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:45:58.167571 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG dbcounter [-] [127033] Writing DB stats nova_cell0:SELECT=16 {{(pid=127033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:45:58.228094 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-cf68d180-f62f-4ad4-86ee-099f56ebb926 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e01f518dbd947bfafa6aecdccd9cfd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981def9b53d4448abde1baf030e5c63c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:45:58.246505 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-cf68d180-f62f-4ad4-86ee-099f56ebb926 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] 10.222.0.52 "GET /compute/v2.1/servers/0c61b6b7-811a-4c77-ab85-d6eb319dd22e" status: 200 len: 1315 microversion: 2.1 time: 2.454859 Oct 28 09:45:58.247964 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 15/29] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:45:55 2022] GET /compute/v2.1/servers/0c61b6b7-811a-4c77-ab85-d6eb319dd22e => generated 1315 bytes in 2457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:45:58.568814 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.virt.hardware [None req-edc163c8-881d-4ad2-9a97-e8de5c393972 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Flavor limits 0:0:0 {{(pid=127033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 09:45:58.569579 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.virt.hardware [None req-edc163c8-881d-4ad2-9a97-e8de5c393972 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Image limits 0:0:0 {{(pid=127033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 09:45:58.570132 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.virt.hardware [None req-edc163c8-881d-4ad2-9a97-e8de5c393972 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Flavor pref 0:0:0 {{(pid=127033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 09:45:58.570556 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.virt.hardware [None req-edc163c8-881d-4ad2-9a97-e8de5c393972 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Image pref 0:0:0 {{(pid=127033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 09:45:58.571137 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.virt.hardware [None req-edc163c8-881d-4ad2-9a97-e8de5c393972 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 09:45:58.685356 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-edc163c8-881d-4ad2-9a97-e8de5c393972 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:45:58.686055 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-edc163c8-881d-4ad2-9a97-e8de5c393972 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.036s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:45:58.686589 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-edc163c8-881d-4ad2-9a97-e8de5c393972 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:45:58.687502 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-edc163c8-881d-4ad2-9a97-e8de5c393972 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:45:58.697763 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-edc163c8-881d-4ad2-9a97-e8de5c393972 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:45:58.701025 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-edc163c8-881d-4ad2-9a97-e8de5c393972 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:45:58.761710 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.quota [None req-edc163c8-881d-4ad2-9a97-e8de5c393972 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Getting quotas for project ae5e7d531c0f4a33a869309af965e3e5. Resources: {'cores', 'ram', 'instances'} {{(pid=127033) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 09:45:58.770707 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.quota [None req-edc163c8-881d-4ad2-9a97-e8de5c393972 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Getting quotas for user 8bee2d5f599642788c32e0d8b8338c19 and project ae5e7d531c0f4a33a869309af965e3e5. Resources: {'cores', 'ram', 'instances'} {{(pid=127033) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 09:45:58.807292 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-edc163c8-881d-4ad2-9a97-e8de5c393972 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Going to run 1 instances... {{(pid=127033) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 09:45:58.813771 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-edc163c8-881d-4ad2-9a97-e8de5c393972 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] [instance: 91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e314146-a2ed-4f8b-afdd-4f7ed1184d20',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127033) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 09:45:58.913800 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-edc163c8-881d-4ad2-9a97-e8de5c393972 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 5.371719 Oct 28 09:45:58.914864 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 15/30] 10.222.0.52 () {60 vars in 1147 bytes} [Fri Oct 28 09:45:53 2022] POST /compute/v2.1/servers => generated 401 bytes in 5374 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 09:45:58.925984 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-be2c0eb4-d083-49a6-9ec3-c9f65e767d17 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:45:58.926884 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-be2c0eb4-d083-49a6-9ec3-c9f65e767d17 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] [instance: 91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:45:59.016901 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-be2c0eb4-d083-49a6-9ec3-c9f65e767d17 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bee2d5f599642788c32e0d8b8338c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e7d531c0f4a33a869309af965e3e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:45:59.025571 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-be2c0eb4-d083-49a6-9ec3-c9f65e767d17 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] 10.222.0.52 "GET /compute/v2.1/servers/91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1" status: 200 len: 1237 microversion: 2.1 time: 0.103497 Oct 28 09:45:59.028423 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 16/31] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:45:58 2022] GET /compute/v2.1/servers/91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1 => generated 1237 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:45:59.280200 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-853ce205-fb83-4322-841c-a869e4da3dce tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:45:59.280982 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-853ce205-fb83-4322-841c-a869e4da3dce tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] [instance: 0c61b6b7-811a-4c77-ab85-d6eb319dd22e] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:45:59.293034 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-853ce205-fb83-4322-841c-a869e4da3dce tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:45:59.293544 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-853ce205-fb83-4322-841c-a869e4da3dce tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:45:59.293994 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-853ce205-fb83-4322-841c-a869e4da3dce tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:45:59.297321 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-853ce205-fb83-4322-841c-a869e4da3dce tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:45:59.297828 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-853ce205-fb83-4322-841c-a869e4da3dce tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:45:59.300455 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-853ce205-fb83-4322-841c-a869e4da3dce tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:45:59.557033 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-853ce205-fb83-4322-841c-a869e4da3dce tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e01f518dbd947bfafa6aecdccd9cfd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981def9b53d4448abde1baf030e5c63c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:45:59.563286 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-ea30109b-7a03-401a-aaad-8581bc16b94d tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-175079096", "imageRef": "6e314146-a2ed-4f8b-afdd-4f7ed1184d20", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2ac62534-4a8d-47b6-a325-e372ef145ba3"}], "security_groups": [{"name": "tempest-securitygroup--636900692"}], "key_name": "tempest-keypair-280231662", "user_data": "}} {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:45:59.571916 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-853ce205-fb83-4322-841c-a869e4da3dce tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] 10.222.0.52 "GET /compute/v2.1/servers/0c61b6b7-811a-4c77-ab85-d6eb319dd22e" status: 200 len: 1315 microversion: 2.1 time: 0.296639 Oct 28 09:45:59.573784 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 16/32] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:45:59 2022] GET /compute/v2.1/servers/0c61b6b7-811a-4c77-ab85-d6eb319dd22e => generated 1315 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:45:59.824810 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.network.neutron [None req-ea30109b-7a03-401a-aaad-8581bc16b94d tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] validate_networks() for [('2ac62534-4a8d-47b6-a325-e372ef145ba3', None, None, None, None, None)] {{(pid=127032) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 09:46:00.061378 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-34a2a502-321e-470a-9db8-b148644b5501 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:46:00.062214 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-34a2a502-321e-470a-9db8-b148644b5501 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] [instance: 91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:46:00.241544 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-34a2a502-321e-470a-9db8-b148644b5501 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bee2d5f599642788c32e0d8b8338c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e7d531c0f4a33a869309af965e3e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:46:00.250140 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-34a2a502-321e-470a-9db8-b148644b5501 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] 10.222.0.52 "GET /compute/v2.1/servers/91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1" status: 200 len: 1237 microversion: 2.1 time: 0.195442 Oct 28 09:46:00.258460 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 17/33] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:46:00 2022] GET /compute/v2.1/servers/91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1 => generated 1237 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:46:00.606144 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-d1ba3c9a-9ddf-41ee-a348-2f1e3ef3c264 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:46:00.606949 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-d1ba3c9a-9ddf-41ee-a348-2f1e3ef3c264 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] [instance: 0c61b6b7-811a-4c77-ab85-d6eb319dd22e] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:46:00.614671 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-d1ba3c9a-9ddf-41ee-a348-2f1e3ef3c264 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:00.615631 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-d1ba3c9a-9ddf-41ee-a348-2f1e3ef3c264 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:00.616257 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-d1ba3c9a-9ddf-41ee-a348-2f1e3ef3c264 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:00.617058 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-d1ba3c9a-9ddf-41ee-a348-2f1e3ef3c264 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:00.618015 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-d1ba3c9a-9ddf-41ee-a348-2f1e3ef3c264 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:00.618549 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-d1ba3c9a-9ddf-41ee-a348-2f1e3ef3c264 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:00.802855 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-d1ba3c9a-9ddf-41ee-a348-2f1e3ef3c264 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e01f518dbd947bfafa6aecdccd9cfd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981def9b53d4448abde1baf030e5c63c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:46:00.811722 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-d1ba3c9a-9ddf-41ee-a348-2f1e3ef3c264 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] 10.222.0.52 "GET /compute/v2.1/servers/0c61b6b7-811a-4c77-ab85-d6eb319dd22e" status: 200 len: 1315 microversion: 2.1 time: 0.210120 Oct 28 09:46:00.812156 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 18/34] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:46:00 2022] GET /compute/v2.1/servers/0c61b6b7-811a-4c77-ab85-d6eb319dd22e => generated 1315 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:46:01.172694 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.virt.hardware [None req-ea30109b-7a03-401a-aaad-8581bc16b94d tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Flavor limits 0:0:0 {{(pid=127032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 09:46:01.173713 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.virt.hardware [None req-ea30109b-7a03-401a-aaad-8581bc16b94d tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Image limits 0:0:0 {{(pid=127032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 09:46:01.180379 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.virt.hardware [None req-ea30109b-7a03-401a-aaad-8581bc16b94d tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Flavor pref 0:0:0 {{(pid=127032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 09:46:01.180379 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.virt.hardware [None req-ea30109b-7a03-401a-aaad-8581bc16b94d tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Image pref 0:0:0 {{(pid=127032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 09:46:01.180379 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.virt.hardware [None req-ea30109b-7a03-401a-aaad-8581bc16b94d tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 09:46:01.180379 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG dbcounter [-] [127032] Writing DB stats nova_api:SELECT=25 {{(pid=127032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:46:01.200805 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ea30109b-7a03-401a-aaad-8581bc16b94d tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:01.201297 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ea30109b-7a03-401a-aaad-8581bc16b94d tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:01.201722 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ea30109b-7a03-401a-aaad-8581bc16b94d tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:01.202681 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ea30109b-7a03-401a-aaad-8581bc16b94d tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:01.203333 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ea30109b-7a03-401a-aaad-8581bc16b94d tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:01.203989 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ea30109b-7a03-401a-aaad-8581bc16b94d tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:01.232830 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG dbcounter [-] [127032] Writing DB stats nova_cell1:SELECT=35 {{(pid=127032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:46:01.253060 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.quota [None req-ea30109b-7a03-401a-aaad-8581bc16b94d tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Getting quotas for project 500be47836b44a769f676e3e4bc00721. Resources: {'cores', 'ram', 'instances'} {{(pid=127032) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 09:46:01.261322 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.quota [None req-ea30109b-7a03-401a-aaad-8581bc16b94d tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Getting quotas for user cdb5ce192c764fe4946542f5960ccd39 and project 500be47836b44a769f676e3e4bc00721. Resources: {'cores', 'ram', 'instances'} {{(pid=127032) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 09:46:01.285326 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-4eb32c66-b8d6-4be1-8a79-f26106582cd0 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:46:01.286081 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-4eb32c66-b8d6-4be1-8a79-f26106582cd0 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] [instance: 91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:46:01.295613 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG dbcounter [-] [127033] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=8 {{(pid=127033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:46:01.301736 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-ea30109b-7a03-401a-aaad-8581bc16b94d tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Going to run 1 instances... {{(pid=127032) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 09:46:01.305474 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-4eb32c66-b8d6-4be1-8a79-f26106582cd0 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:01.306288 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-4eb32c66-b8d6-4be1-8a79-f26106582cd0 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:01.307322 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-4eb32c66-b8d6-4be1-8a79-f26106582cd0 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:01.311841 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-4eb32c66-b8d6-4be1-8a79-f26106582cd0 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:01.315585 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-4eb32c66-b8d6-4be1-8a79-f26106582cd0 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:01.316701 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-4eb32c66-b8d6-4be1-8a79-f26106582cd0 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:01.318663 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-ea30109b-7a03-401a-aaad-8581bc16b94d tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 6869ffb6-ce4f-4a91-b8d9-7765ea56e95a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e314146-a2ed-4f8b-afdd-4f7ed1184d20',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127032) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 09:46:01.340221 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG dbcounter [-] [127033] Writing DB stats nova_cell1:SELECT=29 {{(pid=127033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:46:01.469752 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-ea30109b-7a03-401a-aaad-8581bc16b94d tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.911839 Oct 28 09:46:01.470951 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 17/35] 10.222.0.52 () {62 vars in 1188 bytes} [Fri Oct 28 09:45:59 2022] POST /compute/v2.1/servers => generated 401 bytes in 1914 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 28 09:46:01.492092 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-472553dd-0350-4084-97eb-d61e93b526e0 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:46:01.493438 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-472553dd-0350-4084-97eb-d61e93b526e0 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 6869ffb6-ce4f-4a91-b8d9-7765ea56e95a] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:46:01.507093 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-4eb32c66-b8d6-4be1-8a79-f26106582cd0 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bee2d5f599642788c32e0d8b8338c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e7d531c0f4a33a869309af965e3e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:46:01.528760 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-4eb32c66-b8d6-4be1-8a79-f26106582cd0 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] 10.222.0.52 "GET /compute/v2.1/servers/91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1" status: 200 len: 1241 microversion: 2.1 time: 0.249429 Oct 28 09:46:01.529453 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 19/36] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:46:01 2022] GET /compute/v2.1/servers/91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1 => generated 1241 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:46:01.820176 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-472553dd-0350-4084-97eb-d61e93b526e0 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:46:01.840272 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-7937ca7d-c6ab-4bf3-aa18-2cb3361741fc tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:46:01.840897 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-7937ca7d-c6ab-4bf3-aa18-2cb3361741fc tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] [instance: 0c61b6b7-811a-4c77-ab85-d6eb319dd22e] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:46:01.847545 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-472553dd-0350-4084-97eb-d61e93b526e0 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:46:01.849705 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-7937ca7d-c6ab-4bf3-aa18-2cb3361741fc tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:01.851953 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-472553dd-0350-4084-97eb-d61e93b526e0 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:46:01.853224 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-7937ca7d-c6ab-4bf3-aa18-2cb3361741fc tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:01.855380 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-472553dd-0350-4084-97eb-d61e93b526e0 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a" status: 200 len: 1280 microversion: 2.20 time: 0.375286 Oct 28 09:46:01.856572 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-7937ca7d-c6ab-4bf3-aa18-2cb3361741fc tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:01.859245 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-7937ca7d-c6ab-4bf3-aa18-2cb3361741fc tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:01.860945 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-7937ca7d-c6ab-4bf3-aa18-2cb3361741fc tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:01.861342 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 18/37] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:46:01 2022] GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a => generated 1280 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:46:01.862103 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-7937ca7d-c6ab-4bf3-aa18-2cb3361741fc tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:02.100923 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-7937ca7d-c6ab-4bf3-aa18-2cb3361741fc tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e01f518dbd947bfafa6aecdccd9cfd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981def9b53d4448abde1baf030e5c63c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:46:02.110762 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-7937ca7d-c6ab-4bf3-aa18-2cb3361741fc tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] 10.222.0.52 "GET /compute/v2.1/servers/0c61b6b7-811a-4c77-ab85-d6eb319dd22e" status: 200 len: 1315 microversion: 2.1 time: 0.274124 Oct 28 09:46:02.111726 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 20/38] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:46:01 2022] GET /compute/v2.1/servers/0c61b6b7-811a-4c77-ab85-d6eb319dd22e => generated 1315 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:46:02.556220 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-9490f8d9-508c-4ce1-9369-d3037a030e3c tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:46:02.557740 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-9490f8d9-508c-4ce1-9369-d3037a030e3c tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] [instance: 91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:46:02.564971 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-9490f8d9-508c-4ce1-9369-d3037a030e3c tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:02.565498 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-9490f8d9-508c-4ce1-9369-d3037a030e3c tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:02.565947 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-9490f8d9-508c-4ce1-9369-d3037a030e3c tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:02.566801 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-9490f8d9-508c-4ce1-9369-d3037a030e3c tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:02.567444 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-9490f8d9-508c-4ce1-9369-d3037a030e3c tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:02.568757 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-9490f8d9-508c-4ce1-9369-d3037a030e3c tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:02.645227 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-9490f8d9-508c-4ce1-9369-d3037a030e3c tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bee2d5f599642788c32e0d8b8338c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e7d531c0f4a33a869309af965e3e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:46:02.655359 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-9490f8d9-508c-4ce1-9369-d3037a030e3c tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] 10.222.0.52 "GET /compute/v2.1/servers/91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1" status: 200 len: 1289 microversion: 2.1 time: 0.103930 Oct 28 09:46:02.667964 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 19/39] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:46:02 2022] GET /compute/v2.1/servers/91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1 => generated 1289 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:46:02.885650 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-1355645b-fd07-4dff-90a9-aaad442f6530 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:46:02.886116 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-1355645b-fd07-4dff-90a9-aaad442f6530 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 6869ffb6-ce4f-4a91-b8d9-7765ea56e95a] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:46:02.892170 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-1355645b-fd07-4dff-90a9-aaad442f6530 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:02.892889 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-1355645b-fd07-4dff-90a9-aaad442f6530 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:02.893336 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-1355645b-fd07-4dff-90a9-aaad442f6530 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:02.894043 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-1355645b-fd07-4dff-90a9-aaad442f6530 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:02.894505 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-1355645b-fd07-4dff-90a9-aaad442f6530 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:02.894929 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-1355645b-fd07-4dff-90a9-aaad442f6530 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:02.992822 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-1355645b-fd07-4dff-90a9-aaad442f6530 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:46:03.009241 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-1355645b-fd07-4dff-90a9-aaad442f6530 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:46:03.012026 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-1355645b-fd07-4dff-90a9-aaad442f6530 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:46:03.014032 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-1355645b-fd07-4dff-90a9-aaad442f6530 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a" status: 200 len: 1284 microversion: 2.20 time: 0.132673 Oct 28 09:46:03.014978 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 21/40] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:46:02 2022] GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a => generated 1284 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:46:03.135567 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-0157bf12-5ae4-43ac-af65-844950e3507b tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:46:03.136167 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-0157bf12-5ae4-43ac-af65-844950e3507b tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] [instance: 0c61b6b7-811a-4c77-ab85-d6eb319dd22e] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:46:03.151557 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-0157bf12-5ae4-43ac-af65-844950e3507b tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:03.160979 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-0157bf12-5ae4-43ac-af65-844950e3507b tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:03.161857 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-0157bf12-5ae4-43ac-af65-844950e3507b tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:03.162995 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-0157bf12-5ae4-43ac-af65-844950e3507b tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:03.163907 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-0157bf12-5ae4-43ac-af65-844950e3507b tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:03.164845 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-0157bf12-5ae4-43ac-af65-844950e3507b tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:03.378333 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-0157bf12-5ae4-43ac-af65-844950e3507b tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e01f518dbd947bfafa6aecdccd9cfd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981def9b53d4448abde1baf030e5c63c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:46:03.386702 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-0157bf12-5ae4-43ac-af65-844950e3507b tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] 10.222.0.52 "GET /compute/v2.1/servers/0c61b6b7-811a-4c77-ab85-d6eb319dd22e" status: 200 len: 1315 microversion: 2.1 time: 0.255952 Oct 28 09:46:03.387608 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 20/41] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:46:03 2022] GET /compute/v2.1/servers/0c61b6b7-811a-4c77-ab85-d6eb319dd22e => generated 1315 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:46:03.679808 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-83763a61-5fb3-4347-bb62-705360453214 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:46:03.680784 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-83763a61-5fb3-4347-bb62-705360453214 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] [instance: 91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:46:03.696654 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-83763a61-5fb3-4347-bb62-705360453214 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:03.699113 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-83763a61-5fb3-4347-bb62-705360453214 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:03.700786 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-83763a61-5fb3-4347-bb62-705360453214 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:03.702862 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-83763a61-5fb3-4347-bb62-705360453214 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:03.704133 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-83763a61-5fb3-4347-bb62-705360453214 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:03.705050 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-83763a61-5fb3-4347-bb62-705360453214 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:03.827334 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-83763a61-5fb3-4347-bb62-705360453214 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bee2d5f599642788c32e0d8b8338c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e7d531c0f4a33a869309af965e3e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:46:03.838627 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-83763a61-5fb3-4347-bb62-705360453214 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] 10.222.0.52 "GET /compute/v2.1/servers/91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1" status: 200 len: 1289 microversion: 2.1 time: 0.163712 Oct 28 09:46:03.839475 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 22/42] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:46:03 2022] GET /compute/v2.1/servers/91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1 => generated 1289 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:46:04.042422 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-66d14de1-6c2b-49dd-95a1-5175acc07cfc tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:46:04.043874 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-66d14de1-6c2b-49dd-95a1-5175acc07cfc tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 6869ffb6-ce4f-4a91-b8d9-7765ea56e95a] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:46:04.051850 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-66d14de1-6c2b-49dd-95a1-5175acc07cfc tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:04.052908 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-66d14de1-6c2b-49dd-95a1-5175acc07cfc tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:04.053742 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-66d14de1-6c2b-49dd-95a1-5175acc07cfc tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:04.054798 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-66d14de1-6c2b-49dd-95a1-5175acc07cfc tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:04.055579 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-66d14de1-6c2b-49dd-95a1-5175acc07cfc tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:04.056278 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-66d14de1-6c2b-49dd-95a1-5175acc07cfc tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:04.235570 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-66d14de1-6c2b-49dd-95a1-5175acc07cfc tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:46:04.269908 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-66d14de1-6c2b-49dd-95a1-5175acc07cfc tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:46:04.287164 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-66d14de1-6c2b-49dd-95a1-5175acc07cfc tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:46:04.290386 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-66d14de1-6c2b-49dd-95a1-5175acc07cfc tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a" status: 200 len: 1284 microversion: 2.20 time: 0.252108 Oct 28 09:46:04.291455 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 21/43] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:46:04 2022] GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a => generated 1284 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:46:04.415815 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-170d2132-0286-423d-adf6-bb161558eeae tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:46:04.416957 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-170d2132-0286-423d-adf6-bb161558eeae tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] [instance: 0c61b6b7-811a-4c77-ab85-d6eb319dd22e] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:46:04.432898 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-170d2132-0286-423d-adf6-bb161558eeae tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:04.433928 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-170d2132-0286-423d-adf6-bb161558eeae tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:04.434836 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-170d2132-0286-423d-adf6-bb161558eeae tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:04.435897 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-170d2132-0286-423d-adf6-bb161558eeae tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:04.436517 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-170d2132-0286-423d-adf6-bb161558eeae tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:04.437165 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-170d2132-0286-423d-adf6-bb161558eeae tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:04.783255 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-170d2132-0286-423d-adf6-bb161558eeae tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e01f518dbd947bfafa6aecdccd9cfd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981def9b53d4448abde1baf030e5c63c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:46:04.796004 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-170d2132-0286-423d-adf6-bb161558eeae tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] 10.222.0.52 "GET /compute/v2.1/servers/0c61b6b7-811a-4c77-ab85-d6eb319dd22e" status: 200 len: 1315 microversion: 2.1 time: 0.384694 Oct 28 09:46:04.797452 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 23/44] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:46:04 2022] GET /compute/v2.1/servers/0c61b6b7-811a-4c77-ab85-d6eb319dd22e => generated 1315 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:46:04.878887 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-ece130b4-c674-4413-9756-5930850dce05 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:46:04.879847 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-ece130b4-c674-4413-9756-5930850dce05 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] [instance: 91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:46:04.901764 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ece130b4-c674-4413-9756-5930850dce05 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:04.902281 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ece130b4-c674-4413-9756-5930850dce05 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:04.902833 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ece130b4-c674-4413-9756-5930850dce05 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:04.904260 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ece130b4-c674-4413-9756-5930850dce05 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:04.905236 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ece130b4-c674-4413-9756-5930850dce05 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:04.905803 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ece130b4-c674-4413-9756-5930850dce05 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:05.060494 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-ece130b4-c674-4413-9756-5930850dce05 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bee2d5f599642788c32e0d8b8338c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e7d531c0f4a33a869309af965e3e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:46:05.081168 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-ece130b4-c674-4413-9756-5930850dce05 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] 10.222.0.52 "GET /compute/v2.1/servers/91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1" status: 200 len: 1289 microversion: 2.1 time: 0.206993 Oct 28 09:46:05.088828 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 22/45] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:46:04 2022] GET /compute/v2.1/servers/91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1 => generated 1289 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:46:05.341406 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-f08ef86d-0909-4b92-9e7c-8a4d66ba2bba tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:46:05.342527 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-f08ef86d-0909-4b92-9e7c-8a4d66ba2bba tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 6869ffb6-ce4f-4a91-b8d9-7765ea56e95a] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:46:05.394675 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-f08ef86d-0909-4b92-9e7c-8a4d66ba2bba tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:05.395176 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-f08ef86d-0909-4b92-9e7c-8a4d66ba2bba tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:05.395620 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-f08ef86d-0909-4b92-9e7c-8a4d66ba2bba tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:05.396422 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-f08ef86d-0909-4b92-9e7c-8a4d66ba2bba tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:05.396923 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-f08ef86d-0909-4b92-9e7c-8a4d66ba2bba tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:05.397934 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-f08ef86d-0909-4b92-9e7c-8a4d66ba2bba tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:05.551814 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-f08ef86d-0909-4b92-9e7c-8a4d66ba2bba tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:46:05.565345 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-f08ef86d-0909-4b92-9e7c-8a4d66ba2bba tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:46:05.567295 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-f08ef86d-0909-4b92-9e7c-8a4d66ba2bba tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:46:05.568582 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-f08ef86d-0909-4b92-9e7c-8a4d66ba2bba tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a" status: 200 len: 1332 microversion: 2.20 time: 0.236694 Oct 28 09:46:05.585493 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 24/46] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:46:05 2022] GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a => generated 1332 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:46:05.823829 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-e75aac12-09c8-42a8-be0d-c038816a936d tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:46:05.824684 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-e75aac12-09c8-42a8-be0d-c038816a936d tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] [instance: 0c61b6b7-811a-4c77-ab85-d6eb319dd22e] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:46:05.832705 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-e75aac12-09c8-42a8-be0d-c038816a936d tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:05.833347 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-e75aac12-09c8-42a8-be0d-c038816a936d tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:05.833908 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-e75aac12-09c8-42a8-be0d-c038816a936d tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:05.834712 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-e75aac12-09c8-42a8-be0d-c038816a936d tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:05.835189 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-e75aac12-09c8-42a8-be0d-c038816a936d tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:05.839443 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-e75aac12-09c8-42a8-be0d-c038816a936d tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:06.112424 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-711a2fdc-efc0-4398-a509-e11fc1541672 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:46:06.113239 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-711a2fdc-efc0-4398-a509-e11fc1541672 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] [instance: 91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:46:06.122184 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-711a2fdc-efc0-4398-a509-e11fc1541672 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:06.123058 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-711a2fdc-efc0-4398-a509-e11fc1541672 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:06.123984 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-711a2fdc-efc0-4398-a509-e11fc1541672 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:06.125267 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-711a2fdc-efc0-4398-a509-e11fc1541672 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:06.125932 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-711a2fdc-efc0-4398-a509-e11fc1541672 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:06.126618 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-711a2fdc-efc0-4398-a509-e11fc1541672 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:06.345226 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-711a2fdc-efc0-4398-a509-e11fc1541672 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bee2d5f599642788c32e0d8b8338c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e7d531c0f4a33a869309af965e3e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:46:06.360550 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-711a2fdc-efc0-4398-a509-e11fc1541672 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] 10.222.0.52 "GET /compute/v2.1/servers/91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1" status: 200 len: 1295 microversion: 2.1 time: 0.252792 Oct 28 09:46:06.362866 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 25/47] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:46:06 2022] GET /compute/v2.1/servers/91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1 => generated 1295 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:46:06.488935 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-e75aac12-09c8-42a8-be0d-c038816a936d tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e01f518dbd947bfafa6aecdccd9cfd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981def9b53d4448abde1baf030e5c63c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:46:06.503133 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-e75aac12-09c8-42a8-be0d-c038816a936d tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] 10.222.0.52 "GET /compute/v2.1/servers/0c61b6b7-811a-4c77-ab85-d6eb319dd22e" status: 200 len: 1315 microversion: 2.1 time: 0.682617 Oct 28 09:46:06.507786 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 23/48] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:46:05 2022] GET /compute/v2.1/servers/0c61b6b7-811a-4c77-ab85-d6eb319dd22e => generated 1315 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:46:06.597802 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-360965f5-8736-4a93-8683-eb0499f27928 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:46:06.598426 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-360965f5-8736-4a93-8683-eb0499f27928 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 6869ffb6-ce4f-4a91-b8d9-7765ea56e95a] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:46:06.612893 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-360965f5-8736-4a93-8683-eb0499f27928 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:06.613864 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-360965f5-8736-4a93-8683-eb0499f27928 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:06.614281 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-360965f5-8736-4a93-8683-eb0499f27928 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:06.615064 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-360965f5-8736-4a93-8683-eb0499f27928 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:06.616272 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-360965f5-8736-4a93-8683-eb0499f27928 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:06.616710 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-360965f5-8736-4a93-8683-eb0499f27928 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:06.757317 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-360965f5-8736-4a93-8683-eb0499f27928 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:46:06.766792 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-360965f5-8736-4a93-8683-eb0499f27928 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:46:06.768724 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-360965f5-8736-4a93-8683-eb0499f27928 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:46:06.770079 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-360965f5-8736-4a93-8683-eb0499f27928 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a" status: 200 len: 1338 microversion: 2.20 time: 0.176332 Oct 28 09:46:06.770838 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 26/49] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:46:06 2022] GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a => generated 1338 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:46:07.388264 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-4fd5d16f-6712-475c-a2d3-79a674c68c3c tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:46:07.388900 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-4fd5d16f-6712-475c-a2d3-79a674c68c3c tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] [instance: 91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:46:07.399644 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-4fd5d16f-6712-475c-a2d3-79a674c68c3c tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:07.405760 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-4fd5d16f-6712-475c-a2d3-79a674c68c3c tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:07.432389 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-4fd5d16f-6712-475c-a2d3-79a674c68c3c tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:07.433732 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-4fd5d16f-6712-475c-a2d3-79a674c68c3c tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:07.435950 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-4fd5d16f-6712-475c-a2d3-79a674c68c3c tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:07.437235 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-4fd5d16f-6712-475c-a2d3-79a674c68c3c tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:07.533247 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-3d4c5737-2803-46fd-9308-ddfc6e8af6f9 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:46:07.534154 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-3d4c5737-2803-46fd-9308-ddfc6e8af6f9 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] [instance: 0c61b6b7-811a-4c77-ab85-d6eb319dd22e] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:46:07.547395 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-3d4c5737-2803-46fd-9308-ddfc6e8af6f9 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:07.549693 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-3d4c5737-2803-46fd-9308-ddfc6e8af6f9 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:07.551187 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-3d4c5737-2803-46fd-9308-ddfc6e8af6f9 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:07.554274 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-3d4c5737-2803-46fd-9308-ddfc6e8af6f9 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:07.556358 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-3d4c5737-2803-46fd-9308-ddfc6e8af6f9 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:07.557158 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-3d4c5737-2803-46fd-9308-ddfc6e8af6f9 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:07.644037 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-4fd5d16f-6712-475c-a2d3-79a674c68c3c tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bee2d5f599642788c32e0d8b8338c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e7d531c0f4a33a869309af965e3e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:46:07.658600 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-4fd5d16f-6712-475c-a2d3-79a674c68c3c tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] 10.222.0.52 "GET /compute/v2.1/servers/91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1" status: 200 len: 1295 microversion: 2.1 time: 0.273856 Oct 28 09:46:07.690469 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 24/50] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:46:07 2022] GET /compute/v2.1/servers/91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1 => generated 1295 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:46:07.827476 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-46fbab25-e32e-4b15-8aa3-415d8083eca1 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:46:07.828576 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-46fbab25-e32e-4b15-8aa3-415d8083eca1 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 6869ffb6-ce4f-4a91-b8d9-7765ea56e95a] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:46:07.836441 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-46fbab25-e32e-4b15-8aa3-415d8083eca1 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:07.837242 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-46fbab25-e32e-4b15-8aa3-415d8083eca1 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:07.837946 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-46fbab25-e32e-4b15-8aa3-415d8083eca1 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:07.839113 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-46fbab25-e32e-4b15-8aa3-415d8083eca1 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:07.839595 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-46fbab25-e32e-4b15-8aa3-415d8083eca1 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:07.840304 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-46fbab25-e32e-4b15-8aa3-415d8083eca1 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:07.841333 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-3d4c5737-2803-46fd-9308-ddfc6e8af6f9 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e01f518dbd947bfafa6aecdccd9cfd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981def9b53d4448abde1baf030e5c63c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:46:07.853383 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-3d4c5737-2803-46fd-9308-ddfc6e8af6f9 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] 10.222.0.52 "GET /compute/v2.1/servers/0c61b6b7-811a-4c77-ab85-d6eb319dd22e" status: 200 len: 1315 microversion: 2.1 time: 0.325395 Oct 28 09:46:07.854877 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 27/51] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:46:07 2022] GET /compute/v2.1/servers/0c61b6b7-811a-4c77-ab85-d6eb319dd22e => generated 1315 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:46:07.937859 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-46fbab25-e32e-4b15-8aa3-415d8083eca1 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:46:07.951561 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-46fbab25-e32e-4b15-8aa3-415d8083eca1 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:46:07.953921 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-46fbab25-e32e-4b15-8aa3-415d8083eca1 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:46:07.955507 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-46fbab25-e32e-4b15-8aa3-415d8083eca1 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a" status: 200 len: 1338 microversion: 2.20 time: 0.133450 Oct 28 09:46:07.967973 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 25/52] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:46:07 2022] GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a => generated 1338 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:46:08.699811 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-257a8325-22a8-49bd-a568-d6ed2c742809 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:46:08.700543 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-257a8325-22a8-49bd-a568-d6ed2c742809 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] [instance: 91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:46:08.715437 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-257a8325-22a8-49bd-a568-d6ed2c742809 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:08.717627 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-257a8325-22a8-49bd-a568-d6ed2c742809 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:08.719056 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-257a8325-22a8-49bd-a568-d6ed2c742809 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:08.720542 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-257a8325-22a8-49bd-a568-d6ed2c742809 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:08.726315 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-257a8325-22a8-49bd-a568-d6ed2c742809 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:08.727110 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-257a8325-22a8-49bd-a568-d6ed2c742809 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:08.734118 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG dbcounter [-] [127033] Writing DB stats nova_cell0:SELECT=2 {{(pid=127033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:46:08.879548 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-ae0f1814-11c7-47b6-935a-4f2eb752355b tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:46:08.880352 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-ae0f1814-11c7-47b6-935a-4f2eb752355b tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] [instance: 0c61b6b7-811a-4c77-ab85-d6eb319dd22e] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:46:08.902414 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ae0f1814-11c7-47b6-935a-4f2eb752355b tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:08.902961 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ae0f1814-11c7-47b6-935a-4f2eb752355b tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:08.903409 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ae0f1814-11c7-47b6-935a-4f2eb752355b tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:08.904238 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ae0f1814-11c7-47b6-935a-4f2eb752355b tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:08.904706 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ae0f1814-11c7-47b6-935a-4f2eb752355b tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:08.920514 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ae0f1814-11c7-47b6-935a-4f2eb752355b tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:09.781423 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-257a8325-22a8-49bd-a568-d6ed2c742809 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bee2d5f599642788c32e0d8b8338c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e7d531c0f4a33a869309af965e3e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:46:09.794879 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-257a8325-22a8-49bd-a568-d6ed2c742809 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] 10.222.0.52 "GET /compute/v2.1/servers/91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1" status: 200 len: 1362 microversion: 2.1 time: 1.100533 Oct 28 09:46:09.797586 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 28/53] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:46:08 2022] GET /compute/v2.1/servers/91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1 => generated 1362 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:46:09.803787 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-863cad1d-ddd5-4706-8b2a-aa562d937893 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:46:09.804392 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-863cad1d-ddd5-4706-8b2a-aa562d937893 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 6869ffb6-ce4f-4a91-b8d9-7765ea56e95a] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:46:09.820696 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-863cad1d-ddd5-4706-8b2a-aa562d937893 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:09.821447 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-863cad1d-ddd5-4706-8b2a-aa562d937893 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:09.824408 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-863cad1d-ddd5-4706-8b2a-aa562d937893 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:09.825347 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-863cad1d-ddd5-4706-8b2a-aa562d937893 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:09.827720 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-863cad1d-ddd5-4706-8b2a-aa562d937893 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:09.828300 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-863cad1d-ddd5-4706-8b2a-aa562d937893 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:10.080335 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-ae0f1814-11c7-47b6-935a-4f2eb752355b tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e01f518dbd947bfafa6aecdccd9cfd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981def9b53d4448abde1baf030e5c63c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:46:10.093456 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-ae0f1814-11c7-47b6-935a-4f2eb752355b tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] 10.222.0.52 "GET /compute/v2.1/servers/0c61b6b7-811a-4c77-ab85-d6eb319dd22e" status: 200 len: 1315 microversion: 2.1 time: 1.217772 Oct 28 09:46:10.095015 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 26/54] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:46:08 2022] GET /compute/v2.1/servers/0c61b6b7-811a-4c77-ab85-d6eb319dd22e => generated 1315 bytes in 1220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:46:10.154174 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-863cad1d-ddd5-4706-8b2a-aa562d937893 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:46:10.164640 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-863cad1d-ddd5-4706-8b2a-aa562d937893 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:46:10.166304 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-863cad1d-ddd5-4706-8b2a-aa562d937893 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:46:10.167583 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-863cad1d-ddd5-4706-8b2a-aa562d937893 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a" status: 200 len: 1405 microversion: 2.20 time: 0.368294 Oct 28 09:46:10.168650 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 29/55] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:46:09 2022] GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a => generated 1405 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:46:10.534258 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [req-d020f5f3-cd87-4ef7-8801-d4365bc6d87b req-19d76647-3c42-4675-99a8-45477470c070 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c61b6b7-811a-4c77-ab85-d6eb319dd22e", "name": "network-vif-plugged", "status": "completed", "tag": "9d73f353-d1c2-4f15-835d-d4a3b3feef41"}]} {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:46:10.578082 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-d020f5f3-cd87-4ef7-8801-d4365bc6d87b req-19d76647-3c42-4675-99a8-45477470c070 service nova] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:10.580826 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-d020f5f3-cd87-4ef7-8801-d4365bc6d87b req-19d76647-3c42-4675-99a8-45477470c070 service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:10.581890 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-d020f5f3-cd87-4ef7-8801-d4365bc6d87b req-19d76647-3c42-4675-99a8-45477470c070 service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:10.648912 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.compute.server_external_events [req-d020f5f3-cd87-4ef7-8801-d4365bc6d87b req-19d76647-3c42-4675-99a8-45477470c070 service nova] Creating event network-vif-plugged:9d73f353-d1c2-4f15-835d-d4a3b3feef41 for instance 0c61b6b7-811a-4c77-ab85-d6eb319dd22e on hv-cinder-zed-3 Oct 28 09:46:10.674250 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [req-d020f5f3-cd87-4ef7-8801-d4365bc6d87b req-19d76647-3c42-4675-99a8-45477470c070 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.577121 Oct 28 09:46:10.678010 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 27/56] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Oct 28 09:46:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:46:10.812584 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [req-1f9d9881-a54a-49ec-8d95-a3e787b79944 req-431344f3-b06b-4ea3-b751-0209083d31a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1", "tag": "21924ff0-b505-4c58-b899-422df9458e67"}]} {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:46:10.825161 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-70f9ec9e-7d64-4b1c-b1ce-0198cdbd08a2 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:46:10.826108 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-70f9ec9e-7d64-4b1c-b1ce-0198cdbd08a2 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] [instance: 91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:46:10.842055 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-70f9ec9e-7d64-4b1c-b1ce-0198cdbd08a2 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:10.842563 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-70f9ec9e-7d64-4b1c-b1ce-0198cdbd08a2 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:10.843007 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-70f9ec9e-7d64-4b1c-b1ce-0198cdbd08a2 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:10.843723 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-70f9ec9e-7d64-4b1c-b1ce-0198cdbd08a2 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:10.858538 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-70f9ec9e-7d64-4b1c-b1ce-0198cdbd08a2 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:10.859036 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-70f9ec9e-7d64-4b1c-b1ce-0198cdbd08a2 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:10.863146 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG dbcounter [-] [127033] Writing DB stats nova_cell0:SELECT=8 {{(pid=127033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:46:10.865580 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-1f9d9881-a54a-49ec-8d95-a3e787b79944 req-431344f3-b06b-4ea3-b751-0209083d31a8 service nova] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:10.869319 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-1f9d9881-a54a-49ec-8d95-a3e787b79944 req-431344f3-b06b-4ea3-b751-0209083d31a8 service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:10.870607 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-1f9d9881-a54a-49ec-8d95-a3e787b79944 req-431344f3-b06b-4ea3-b751-0209083d31a8 service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:10.926983 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.compute.server_external_events [req-1f9d9881-a54a-49ec-8d95-a3e787b79944 req-431344f3-b06b-4ea3-b751-0209083d31a8 service nova] Creating event network-changed:21924ff0-b505-4c58-b899-422df9458e67 for instance 91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1 on hv-cinder-zed-3 Oct 28 09:46:10.928312 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-1f9d9881-a54a-49ec-8d95-a3e787b79944 req-431344f3-b06b-4ea3-b751-0209083d31a8 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127033) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 28 09:46:10.928917 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-1f9d9881-a54a-49ec-8d95-a3e787b79944 req-431344f3-b06b-4ea3-b751-0209083d31a8 service nova] Acquired lock "compute-rpcapi-router" {{(pid=127033) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 28 09:46:10.930219 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-d9a18e89-ee9b-4166-b1dd-861c612db84d None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:10.930888 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-d9a18e89-ee9b-4166-b1dd-861c612db84d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:10.942709 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-d9a18e89-ee9b-4166-b1dd-861c612db84d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:10.944390 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-d9a18e89-ee9b-4166-b1dd-861c612db84d None None] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:10.947231 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-d9a18e89-ee9b-4166-b1dd-861c612db84d None None] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:10.947671 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-d9a18e89-ee9b-4166-b1dd-861c612db84d None None] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:10.958495 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.compute.rpcapi [None req-d9a18e89-ee9b-4166-b1dd-861c612db84d None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 28 09:46:10.969282 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-d9a18e89-ee9b-4166-b1dd-861c612db84d None None] Releasing lock "compute-rpcapi-router" {{(pid=127033) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 28 09:46:10.997096 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-d9a18e89-ee9b-4166-b1dd-861c612db84d None None] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.188247 Oct 28 09:46:10.998333 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 30/57] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Oct 28 09:46:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:46:11.103611 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-70f9ec9e-7d64-4b1c-b1ce-0198cdbd08a2 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bee2d5f599642788c32e0d8b8338c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e7d531c0f4a33a869309af965e3e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:46:11.115223 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-70f9ec9e-7d64-4b1c-b1ce-0198cdbd08a2 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] 10.222.0.52 "GET /compute/v2.1/servers/91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1" status: 200 len: 1362 microversion: 2.1 time: 0.294365 Oct 28 09:46:11.132610 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 28/58] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:46:10 2022] GET /compute/v2.1/servers/91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1 => generated 1362 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:46:11.144141 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-6745b85a-445a-4961-8581-9c022d101974 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:46:11.145607 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-6745b85a-445a-4961-8581-9c022d101974 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] [instance: 0c61b6b7-811a-4c77-ab85-d6eb319dd22e] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:46:11.164604 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-6745b85a-445a-4961-8581-9c022d101974 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:11.165209 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-6745b85a-445a-4961-8581-9c022d101974 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:11.165776 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-6745b85a-445a-4961-8581-9c022d101974 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:11.166585 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-6745b85a-445a-4961-8581-9c022d101974 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:11.167150 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-6745b85a-445a-4961-8581-9c022d101974 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:11.167675 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-6745b85a-445a-4961-8581-9c022d101974 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:11.217334 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-530e7bf4-9bdd-472f-bab3-666e117f2ccd tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:46:11.218392 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-530e7bf4-9bdd-472f-bab3-666e117f2ccd tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 6869ffb6-ce4f-4a91-b8d9-7765ea56e95a] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:46:11.265548 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG dbcounter [-] [127032] Writing DB stats nova_cell0:SELECT=4 {{(pid=127032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:46:11.268125 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-530e7bf4-9bdd-472f-bab3-666e117f2ccd tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:11.268704 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-530e7bf4-9bdd-472f-bab3-666e117f2ccd tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:11.269309 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-530e7bf4-9bdd-472f-bab3-666e117f2ccd tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:11.270552 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-530e7bf4-9bdd-472f-bab3-666e117f2ccd tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:11.271521 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-530e7bf4-9bdd-472f-bab3-666e117f2ccd tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:11.272173 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-530e7bf4-9bdd-472f-bab3-666e117f2ccd tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:11.621862 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-6745b85a-445a-4961-8581-9c022d101974 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e01f518dbd947bfafa6aecdccd9cfd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981def9b53d4448abde1baf030e5c63c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:46:11.624435 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-530e7bf4-9bdd-472f-bab3-666e117f2ccd tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:46:11.634226 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-6745b85a-445a-4961-8581-9c022d101974 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] 10.222.0.52 "GET /compute/v2.1/servers/0c61b6b7-811a-4c77-ab85-d6eb319dd22e" status: 200 len: 1315 microversion: 2.1 time: 0.494003 Oct 28 09:46:11.634456 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-530e7bf4-9bdd-472f-bab3-666e117f2ccd tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:46:11.636296 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-530e7bf4-9bdd-472f-bab3-666e117f2ccd tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:46:11.636951 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 31/59] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:46:11 2022] GET /compute/v2.1/servers/0c61b6b7-811a-4c77-ab85-d6eb319dd22e => generated 1315 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:46:11.637811 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-530e7bf4-9bdd-472f-bab3-666e117f2ccd tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a" status: 200 len: 1405 microversion: 2.20 time: 0.445861 Oct 28 09:46:11.653670 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 29/60] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:46:11 2022] GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a => generated 1405 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:46:12.137492 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-27d65ec8-9c3e-4b46-90d6-62b4200388ca tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:46:12.138109 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-27d65ec8-9c3e-4b46-90d6-62b4200388ca tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] [instance: 91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:46:12.149379 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-27d65ec8-9c3e-4b46-90d6-62b4200388ca tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:12.149877 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-27d65ec8-9c3e-4b46-90d6-62b4200388ca tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:12.150324 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-27d65ec8-9c3e-4b46-90d6-62b4200388ca tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:12.151035 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-27d65ec8-9c3e-4b46-90d6-62b4200388ca tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:12.151540 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-27d65ec8-9c3e-4b46-90d6-62b4200388ca tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:12.152000 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-27d65ec8-9c3e-4b46-90d6-62b4200388ca tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:12.485695 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-27d65ec8-9c3e-4b46-90d6-62b4200388ca tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bee2d5f599642788c32e0d8b8338c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e7d531c0f4a33a869309af965e3e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:46:12.493993 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-27d65ec8-9c3e-4b46-90d6-62b4200388ca tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] 10.222.0.52 "GET /compute/v2.1/servers/91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1" status: 200 len: 1362 microversion: 2.1 time: 0.360271 Oct 28 09:46:12.496739 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 32/61] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:46:12 2022] GET /compute/v2.1/servers/91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1 => generated 1362 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:46:12.662715 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-4c206541-e534-4401-8170-ca48147b7e65 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:46:12.663337 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-4c206541-e534-4401-8170-ca48147b7e65 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] [instance: 0c61b6b7-811a-4c77-ab85-d6eb319dd22e] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:46:12.666433 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG dbcounter [-] [127032] Writing DB stats nova_cell0:SELECT=10 {{(pid=127032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:46:12.667564 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-c03da353-4bac-4225-8dea-9f0f4703d86c tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:46:12.668604 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-c03da353-4bac-4225-8dea-9f0f4703d86c tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 6869ffb6-ce4f-4a91-b8d9-7765ea56e95a] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:46:12.670072 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-4c206541-e534-4401-8170-ca48147b7e65 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:12.670572 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-4c206541-e534-4401-8170-ca48147b7e65 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:12.671009 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-4c206541-e534-4401-8170-ca48147b7e65 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:12.671716 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-4c206541-e534-4401-8170-ca48147b7e65 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:12.672195 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-4c206541-e534-4401-8170-ca48147b7e65 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:12.672625 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-4c206541-e534-4401-8170-ca48147b7e65 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:12.684151 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-c03da353-4bac-4225-8dea-9f0f4703d86c tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:12.684690 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-c03da353-4bac-4225-8dea-9f0f4703d86c tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:12.685657 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-c03da353-4bac-4225-8dea-9f0f4703d86c tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:12.688554 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-c03da353-4bac-4225-8dea-9f0f4703d86c tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:12.690767 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-c03da353-4bac-4225-8dea-9f0f4703d86c tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:12.691614 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-c03da353-4bac-4225-8dea-9f0f4703d86c tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:13.121795 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-4c206541-e534-4401-8170-ca48147b7e65 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e01f518dbd947bfafa6aecdccd9cfd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981def9b53d4448abde1baf030e5c63c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:46:13.135725 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-4c206541-e534-4401-8170-ca48147b7e65 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] 10.222.0.52 "GET /compute/v2.1/servers/0c61b6b7-811a-4c77-ab85-d6eb319dd22e" status: 200 len: 1315 microversion: 2.1 time: 0.478334 Oct 28 09:46:13.136763 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 30/62] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:46:12 2022] GET /compute/v2.1/servers/0c61b6b7-811a-4c77-ab85-d6eb319dd22e => generated 1315 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:46:13.145523 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [req-000553b7-4e6e-4438-8aa1-a782f22c27a6 req-1340c43a-3a1d-4dc7-a8d3-4b592ac2a3c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6869ffb6-ce4f-4a91-b8d9-7765ea56e95a", "tag": "f350d1f8-ff54-4a77-b413-0023d0d49856"}]} {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:46:13.169911 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-000553b7-4e6e-4438-8aa1-a782f22c27a6 req-1340c43a-3a1d-4dc7-a8d3-4b592ac2a3c4 service nova] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:13.170772 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-000553b7-4e6e-4438-8aa1-a782f22c27a6 req-1340c43a-3a1d-4dc7-a8d3-4b592ac2a3c4 service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:13.171541 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-000553b7-4e6e-4438-8aa1-a782f22c27a6 req-1340c43a-3a1d-4dc7-a8d3-4b592ac2a3c4 service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:13.192931 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-c03da353-4bac-4225-8dea-9f0f4703d86c tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:46:13.205242 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-c03da353-4bac-4225-8dea-9f0f4703d86c tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:46:13.208469 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-c03da353-4bac-4225-8dea-9f0f4703d86c tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:46:13.209714 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-c03da353-4bac-4225-8dea-9f0f4703d86c tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a" status: 200 len: 1405 microversion: 2.20 time: 0.547523 Oct 28 09:46:13.210318 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 33/63] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:46:12 2022] GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a => generated 1405 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:46:13.245144 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.compute.server_external_events [req-000553b7-4e6e-4438-8aa1-a782f22c27a6 req-1340c43a-3a1d-4dc7-a8d3-4b592ac2a3c4 service nova] Creating event network-changed:f350d1f8-ff54-4a77-b413-0023d0d49856 for instance 6869ffb6-ce4f-4a91-b8d9-7765ea56e95a on hv-cinder-zed-3 Oct 28 09:46:13.271014 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [req-000553b7-4e6e-4438-8aa1-a782f22c27a6 req-1340c43a-3a1d-4dc7-a8d3-4b592ac2a3c4 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131782 Oct 28 09:46:13.272389 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 31/64] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Oct 28 09:46:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:46:13.523139 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-b96c52d7-0109-4961-8372-6001724cc162 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:46:13.528548 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-b96c52d7-0109-4961-8372-6001724cc162 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] [instance: 91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:46:13.549989 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-b96c52d7-0109-4961-8372-6001724cc162 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:13.552157 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-b96c52d7-0109-4961-8372-6001724cc162 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:13.553734 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-b96c52d7-0109-4961-8372-6001724cc162 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:13.557709 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-b96c52d7-0109-4961-8372-6001724cc162 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:13.558801 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-b96c52d7-0109-4961-8372-6001724cc162 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:13.565043 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-b96c52d7-0109-4961-8372-6001724cc162 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:13.842157 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-b96c52d7-0109-4961-8372-6001724cc162 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bee2d5f599642788c32e0d8b8338c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e7d531c0f4a33a869309af965e3e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:46:13.850714 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-b96c52d7-0109-4961-8372-6001724cc162 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] 10.222.0.52 "GET /compute/v2.1/servers/91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1" status: 200 len: 1362 microversion: 2.1 time: 0.334300 Oct 28 09:46:13.864876 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 34/65] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:46:13 2022] GET /compute/v2.1/servers/91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1 => generated 1362 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:46:14.159346 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-ccc21f25-89f0-4f33-a0de-507a518be0a7 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:46:14.164916 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-ccc21f25-89f0-4f33-a0de-507a518be0a7 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] [instance: 0c61b6b7-811a-4c77-ab85-d6eb319dd22e] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:46:14.179802 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ccc21f25-89f0-4f33-a0de-507a518be0a7 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:14.180602 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ccc21f25-89f0-4f33-a0de-507a518be0a7 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:14.181053 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ccc21f25-89f0-4f33-a0de-507a518be0a7 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:14.181819 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ccc21f25-89f0-4f33-a0de-507a518be0a7 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:14.182294 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ccc21f25-89f0-4f33-a0de-507a518be0a7 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:14.182706 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ccc21f25-89f0-4f33-a0de-507a518be0a7 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:14.245016 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-89f8e08c-0e01-4b4d-bbf7-a94fcf7329d3 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:46:14.246275 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-89f8e08c-0e01-4b4d-bbf7-a94fcf7329d3 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 6869ffb6-ce4f-4a91-b8d9-7765ea56e95a] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:46:14.252614 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-89f8e08c-0e01-4b4d-bbf7-a94fcf7329d3 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:14.253428 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-89f8e08c-0e01-4b4d-bbf7-a94fcf7329d3 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:14.254128 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-89f8e08c-0e01-4b4d-bbf7-a94fcf7329d3 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:14.255028 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-89f8e08c-0e01-4b4d-bbf7-a94fcf7329d3 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:14.255702 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-89f8e08c-0e01-4b4d-bbf7-a94fcf7329d3 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:14.256401 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-89f8e08c-0e01-4b4d-bbf7-a94fcf7329d3 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:14.421886 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-ccc21f25-89f0-4f33-a0de-507a518be0a7 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e01f518dbd947bfafa6aecdccd9cfd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981def9b53d4448abde1baf030e5c63c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:46:14.434568 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-ccc21f25-89f0-4f33-a0de-507a518be0a7 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] 10.222.0.52 "GET /compute/v2.1/servers/0c61b6b7-811a-4c77-ab85-d6eb319dd22e" status: 200 len: 1315 microversion: 2.1 time: 0.279362 Oct 28 09:46:14.436306 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 32/66] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:46:14 2022] GET /compute/v2.1/servers/0c61b6b7-811a-4c77-ab85-d6eb319dd22e => generated 1315 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:46:14.504104 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-89f8e08c-0e01-4b4d-bbf7-a94fcf7329d3 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:46:14.542096 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-89f8e08c-0e01-4b4d-bbf7-a94fcf7329d3 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:46:14.544302 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-89f8e08c-0e01-4b4d-bbf7-a94fcf7329d3 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:46:14.545968 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-89f8e08c-0e01-4b4d-bbf7-a94fcf7329d3 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a" status: 200 len: 1405 microversion: 2.20 time: 0.305620 Oct 28 09:46:14.564306 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 35/67] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:46:14 2022] GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a => generated 1405 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:46:14.876814 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-1e9cff4b-6e5e-45c9-b776-08e2e8b4c7cb tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:46:14.877599 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-1e9cff4b-6e5e-45c9-b776-08e2e8b4c7cb tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] [instance: 91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:46:14.891728 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-1e9cff4b-6e5e-45c9-b776-08e2e8b4c7cb tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:14.892225 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-1e9cff4b-6e5e-45c9-b776-08e2e8b4c7cb tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:14.892658 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-1e9cff4b-6e5e-45c9-b776-08e2e8b4c7cb tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:14.893815 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-1e9cff4b-6e5e-45c9-b776-08e2e8b4c7cb tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:14.894283 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-1e9cff4b-6e5e-45c9-b776-08e2e8b4c7cb tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:14.894713 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-1e9cff4b-6e5e-45c9-b776-08e2e8b4c7cb tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:15.216491 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-1e9cff4b-6e5e-45c9-b776-08e2e8b4c7cb tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bee2d5f599642788c32e0d8b8338c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e7d531c0f4a33a869309af965e3e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:46:15.227464 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-1e9cff4b-6e5e-45c9-b776-08e2e8b4c7cb tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] 10.222.0.52 "GET /compute/v2.1/servers/91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1" status: 200 len: 1362 microversion: 2.1 time: 0.355491 Oct 28 09:46:15.228705 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 33/68] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:46:14 2022] GET /compute/v2.1/servers/91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1 => generated 1362 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:46:15.461387 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-e173e402-60b9-46e2-9417-7266e269cca6 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:46:15.462758 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-e173e402-60b9-46e2-9417-7266e269cca6 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] [instance: 0c61b6b7-811a-4c77-ab85-d6eb319dd22e] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:46:15.469239 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-e173e402-60b9-46e2-9417-7266e269cca6 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:15.470084 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-e173e402-60b9-46e2-9417-7266e269cca6 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:15.470726 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-e173e402-60b9-46e2-9417-7266e269cca6 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:15.471641 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-e173e402-60b9-46e2-9417-7266e269cca6 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:15.472344 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-e173e402-60b9-46e2-9417-7266e269cca6 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:15.473144 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-e173e402-60b9-46e2-9417-7266e269cca6 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:15.481292 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG dbcounter [-] [127033] Writing DB stats nova_cell1:SELECT=100 {{(pid=127033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:46:15.574023 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-4dbb6441-5349-4fae-acb6-9f5929cb04d9 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:46:15.574635 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-4dbb6441-5349-4fae-acb6-9f5929cb04d9 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 6869ffb6-ce4f-4a91-b8d9-7765ea56e95a] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:46:15.583473 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-4dbb6441-5349-4fae-acb6-9f5929cb04d9 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:15.583999 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-4dbb6441-5349-4fae-acb6-9f5929cb04d9 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:15.584482 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-4dbb6441-5349-4fae-acb6-9f5929cb04d9 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:15.585383 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-4dbb6441-5349-4fae-acb6-9f5929cb04d9 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:15.585623 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-4dbb6441-5349-4fae-acb6-9f5929cb04d9 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:15.586041 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-4dbb6441-5349-4fae-acb6-9f5929cb04d9 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:15.773880 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-e173e402-60b9-46e2-9417-7266e269cca6 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e01f518dbd947bfafa6aecdccd9cfd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981def9b53d4448abde1baf030e5c63c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:46:15.791054 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-e173e402-60b9-46e2-9417-7266e269cca6 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] 10.222.0.52 "GET /compute/v2.1/servers/0c61b6b7-811a-4c77-ab85-d6eb319dd22e" status: 200 len: 1315 microversion: 2.1 time: 0.337089 Oct 28 09:46:15.793445 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 36/69] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:46:15 2022] GET /compute/v2.1/servers/0c61b6b7-811a-4c77-ab85-d6eb319dd22e => generated 1315 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:46:15.895569 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-4dbb6441-5349-4fae-acb6-9f5929cb04d9 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:46:15.906327 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-4dbb6441-5349-4fae-acb6-9f5929cb04d9 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:46:15.907832 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-4dbb6441-5349-4fae-acb6-9f5929cb04d9 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:46:15.911910 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-4dbb6441-5349-4fae-acb6-9f5929cb04d9 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a" status: 200 len: 1405 microversion: 2.20 time: 0.341675 Oct 28 09:46:15.929038 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 34/70] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:46:15 2022] GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a => generated 1405 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:46:16.270525 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-ee2d0f88-cef9-4bba-bd67-a33d1c7f7968 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:46:16.274119 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-ee2d0f88-cef9-4bba-bd67-a33d1c7f7968 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] [instance: 91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:46:16.283520 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ee2d0f88-cef9-4bba-bd67-a33d1c7f7968 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:16.284734 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ee2d0f88-cef9-4bba-bd67-a33d1c7f7968 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:16.285302 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ee2d0f88-cef9-4bba-bd67-a33d1c7f7968 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:16.286119 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ee2d0f88-cef9-4bba-bd67-a33d1c7f7968 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:16.286710 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ee2d0f88-cef9-4bba-bd67-a33d1c7f7968 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:16.287367 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ee2d0f88-cef9-4bba-bd67-a33d1c7f7968 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:16.528062 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-3e5ac1ee-61f9-48c5-8af5-ba308c34f269 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-220012743", "imageRef": "6e314146-a2ed-4f8b-afdd-4f7ed1184d20", "flavorRef": "452", "networks": [{"uuid": "6631d0d8-b864-481d-a914-8c9e3737f3d4"}]}} {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:46:16.554069 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-ee2d0f88-cef9-4bba-bd67-a33d1c7f7968 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bee2d5f599642788c32e0d8b8338c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e7d531c0f4a33a869309af965e3e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:46:16.566739 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-ee2d0f88-cef9-4bba-bd67-a33d1c7f7968 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] 10.222.0.52 "GET /compute/v2.1/servers/91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1" status: 200 len: 1362 microversion: 2.1 time: 0.302134 Oct 28 09:46:16.567652 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 35/71] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:46:16 2022] GET /compute/v2.1/servers/91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1 => generated 1362 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:46:16.623292 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.network.neutron [None req-3e5ac1ee-61f9-48c5-8af5-ba308c34f269 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] validate_networks() for [('6631d0d8-b864-481d-a914-8c9e3737f3d4', None, None, None, None, None)] {{(pid=127033) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 09:46:16.814622 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-733c1405-2632-4e2e-8d5a-40a33f76ca0b tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:46:16.815231 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-733c1405-2632-4e2e-8d5a-40a33f76ca0b tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] [instance: 0c61b6b7-811a-4c77-ab85-d6eb319dd22e] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:46:16.823591 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-733c1405-2632-4e2e-8d5a-40a33f76ca0b tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:16.825067 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-733c1405-2632-4e2e-8d5a-40a33f76ca0b tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:16.825849 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-733c1405-2632-4e2e-8d5a-40a33f76ca0b tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:16.829678 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-733c1405-2632-4e2e-8d5a-40a33f76ca0b tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:16.830348 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-733c1405-2632-4e2e-8d5a-40a33f76ca0b tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:16.837065 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-733c1405-2632-4e2e-8d5a-40a33f76ca0b tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:17.128883 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-733c1405-2632-4e2e-8d5a-40a33f76ca0b tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e01f518dbd947bfafa6aecdccd9cfd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981def9b53d4448abde1baf030e5c63c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:46:17.133759 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG dbcounter [-] [127032] Writing DB stats nova_cell1:SELECT=100 {{(pid=127032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:46:17.142891 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-733c1405-2632-4e2e-8d5a-40a33f76ca0b tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] 10.222.0.52 "GET /compute/v2.1/servers/0c61b6b7-811a-4c77-ab85-d6eb319dd22e" status: 200 len: 1503 microversion: 2.1 time: 0.331971 Oct 28 09:46:17.156489 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.virt.hardware [None req-3e5ac1ee-61f9-48c5-8af5-ba308c34f269 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Flavor limits 0:0:0 {{(pid=127033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 09:46:17.156489 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.virt.hardware [None req-3e5ac1ee-61f9-48c5-8af5-ba308c34f269 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Image limits 0:0:0 {{(pid=127033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 09:46:17.156489 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.virt.hardware [None req-3e5ac1ee-61f9-48c5-8af5-ba308c34f269 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Flavor pref 0:0:0 {{(pid=127033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 09:46:17.156489 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.virt.hardware [None req-3e5ac1ee-61f9-48c5-8af5-ba308c34f269 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Image pref 0:0:0 {{(pid=127033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 09:46:17.156489 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.virt.hardware [None req-3e5ac1ee-61f9-48c5-8af5-ba308c34f269 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 09:46:17.157844 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 36/72] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:46:16 2022] GET /compute/v2.1/servers/0c61b6b7-811a-4c77-ab85-d6eb319dd22e => generated 1503 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:46:17.165881 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-3e5ac1ee-61f9-48c5-8af5-ba308c34f269 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:17.166439 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-3e5ac1ee-61f9-48c5-8af5-ba308c34f269 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:17.166972 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-3e5ac1ee-61f9-48c5-8af5-ba308c34f269 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:17.167782 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-3e5ac1ee-61f9-48c5-8af5-ba308c34f269 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:17.168540 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-3e5ac1ee-61f9-48c5-8af5-ba308c34f269 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:17.169119 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-3e5ac1ee-61f9-48c5-8af5-ba308c34f269 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:17.172668 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-be3f3f03-533a-4a8d-ae77-6b5ff150d2ca tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:46:17.173665 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-be3f3f03-533a-4a8d-ae77-6b5ff150d2ca tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 6869ffb6-ce4f-4a91-b8d9-7765ea56e95a] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:46:17.187452 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-be3f3f03-533a-4a8d-ae77-6b5ff150d2ca tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:17.188697 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-be3f3f03-533a-4a8d-ae77-6b5ff150d2ca tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:17.190585 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-be3f3f03-533a-4a8d-ae77-6b5ff150d2ca tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:17.192025 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-be3f3f03-533a-4a8d-ae77-6b5ff150d2ca tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:17.192973 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-be3f3f03-533a-4a8d-ae77-6b5ff150d2ca tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:17.193377 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.quota [None req-3e5ac1ee-61f9-48c5-8af5-ba308c34f269 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Getting quotas for project d00b4ea7657d41e6a02531c3509619c9. Resources: {'cores', 'ram', 'instances'} {{(pid=127033) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 09:46:17.194525 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-be3f3f03-533a-4a8d-ae77-6b5ff150d2ca tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:17.198546 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.quota [None req-3e5ac1ee-61f9-48c5-8af5-ba308c34f269 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Getting quotas for user 30363c264f9b4ff5b5e17654bc3e9000 and project d00b4ea7657d41e6a02531c3509619c9. Resources: {'cores', 'ram', 'instances'} {{(pid=127033) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 09:46:17.213482 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-3e5ac1ee-61f9-48c5-8af5-ba308c34f269 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Going to run 1 instances... {{(pid=127033) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 09:46:17.215935 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-3e5ac1ee-61f9-48c5-8af5-ba308c34f269 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] [instance: 2427c17b-fdca-4f26-83bf-65e75775d4c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e314146-a2ed-4f8b-afdd-4f7ed1184d20',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127033) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 09:46:17.277210 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-3e5ac1ee-61f9-48c5-8af5-ba308c34f269 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.028025 Oct 28 09:46:17.284390 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 37/73] 10.222.0.52 () {60 vars in 1147 bytes} [Fri Oct 28 09:46:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1037 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 09:46:17.289853 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-9fe506d4-9398-4cab-be5d-7dcec7734311 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:46:17.290537 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-9fe506d4-9398-4cab-be5d-7dcec7734311 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] [instance: 2427c17b-fdca-4f26-83bf-65e75775d4c4] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:46:17.389252 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-9fe506d4-9398-4cab-be5d-7dcec7734311 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30363c264f9b4ff5b5e17654bc3e9000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00b4ea7657d41e6a02531c3509619c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:46:17.401248 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-9fe506d4-9398-4cab-be5d-7dcec7734311 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] 10.222.0.52 "GET /compute/v2.1/servers/2427c17b-fdca-4f26-83bf-65e75775d4c4" status: 200 len: 1213 microversion: 2.1 time: 0.115440 Oct 28 09:46:17.407797 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 38/74] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:46:17 2022] GET /compute/v2.1/servers/2427c17b-fdca-4f26-83bf-65e75775d4c4 => generated 1213 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:46:17.467490 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-be3f3f03-533a-4a8d-ae77-6b5ff150d2ca tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:46:17.482910 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-be3f3f03-533a-4a8d-ae77-6b5ff150d2ca tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:46:17.491170 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-be3f3f03-533a-4a8d-ae77-6b5ff150d2ca tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:46:17.495050 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-be3f3f03-533a-4a8d-ae77-6b5ff150d2ca tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a" status: 200 len: 1405 microversion: 2.20 time: 0.329062 Oct 28 09:46:17.498886 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 37/75] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:46:17 2022] GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a => generated 1405 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:46:17.607089 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-cffff1d4-47dd-49e6-be2f-3a5921d5325b tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:46:17.607711 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-cffff1d4-47dd-49e6-be2f-3a5921d5325b tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] [instance: 91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:46:17.623283 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-cffff1d4-47dd-49e6-be2f-3a5921d5325b tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:17.646655 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-cffff1d4-47dd-49e6-be2f-3a5921d5325b tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:17.652577 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-cffff1d4-47dd-49e6-be2f-3a5921d5325b tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:17.653395 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-cffff1d4-47dd-49e6-be2f-3a5921d5325b tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:17.653877 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-cffff1d4-47dd-49e6-be2f-3a5921d5325b tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:17.654503 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-cffff1d4-47dd-49e6-be2f-3a5921d5325b tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:18.110564 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-cffff1d4-47dd-49e6-be2f-3a5921d5325b tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bee2d5f599642788c32e0d8b8338c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e7d531c0f4a33a869309af965e3e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:46:18.118835 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-cffff1d4-47dd-49e6-be2f-3a5921d5325b tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] 10.222.0.52 "GET /compute/v2.1/servers/91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1" status: 200 len: 1362 microversion: 2.1 time: 0.527606 Oct 28 09:46:18.119786 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 39/76] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:46:17 2022] GET /compute/v2.1/servers/91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1 => generated 1362 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:46:18.432358 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-17b35262-e625-42d0-a740-2c2f462368af tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:46:18.433492 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-17b35262-e625-42d0-a740-2c2f462368af tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] [instance: 2427c17b-fdca-4f26-83bf-65e75775d4c4] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:46:18.453356 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-17b35262-e625-42d0-a740-2c2f462368af tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:18.453869 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-17b35262-e625-42d0-a740-2c2f462368af tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:18.454346 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-17b35262-e625-42d0-a740-2c2f462368af tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:18.455133 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-17b35262-e625-42d0-a740-2c2f462368af tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:18.455526 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-17b35262-e625-42d0-a740-2c2f462368af tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:18.460829 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-17b35262-e625-42d0-a740-2c2f462368af tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:18.525118 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-76f566c3-ae67-4db8-884e-efbc7e65530a tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:46:18.525767 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-76f566c3-ae67-4db8-884e-efbc7e65530a tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 6869ffb6-ce4f-4a91-b8d9-7765ea56e95a] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:46:18.533175 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-76f566c3-ae67-4db8-884e-efbc7e65530a tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:18.533997 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-76f566c3-ae67-4db8-884e-efbc7e65530a tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:18.534830 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-76f566c3-ae67-4db8-884e-efbc7e65530a tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:18.535809 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-76f566c3-ae67-4db8-884e-efbc7e65530a tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:18.536451 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-76f566c3-ae67-4db8-884e-efbc7e65530a tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:18.537061 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-76f566c3-ae67-4db8-884e-efbc7e65530a tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:18.537370 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-17b35262-e625-42d0-a740-2c2f462368af tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30363c264f9b4ff5b5e17654bc3e9000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00b4ea7657d41e6a02531c3509619c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:46:18.555322 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-17b35262-e625-42d0-a740-2c2f462368af tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] 10.222.0.52 "GET /compute/v2.1/servers/2427c17b-fdca-4f26-83bf-65e75775d4c4" status: 200 len: 1217 microversion: 2.1 time: 0.127310 Oct 28 09:46:18.556209 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 38/77] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:46:18 2022] GET /compute/v2.1/servers/2427c17b-fdca-4f26-83bf-65e75775d4c4 => generated 1217 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:46:18.712851 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-76f566c3-ae67-4db8-884e-efbc7e65530a tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:46:18.724147 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-76f566c3-ae67-4db8-884e-efbc7e65530a tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:46:18.726870 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-76f566c3-ae67-4db8-884e-efbc7e65530a tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:46:18.729612 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-76f566c3-ae67-4db8-884e-efbc7e65530a tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a" status: 200 len: 1405 microversion: 2.20 time: 0.208427 Oct 28 09:46:18.730496 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 40/78] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:46:18 2022] GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a => generated 1405 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:46:18.782632 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [req-ceff8d48-4674-4691-8536-079ecdd14ee3 req-5552d7a9-2656-473a-8bbe-05da8b5a618c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1", "name": "network-vif-plugged", "status": "completed", "tag": "21924ff0-b505-4c58-b899-422df9458e67"}]} {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:46:18.806013 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-ceff8d48-4674-4691-8536-079ecdd14ee3 req-5552d7a9-2656-473a-8bbe-05da8b5a618c service nova] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:18.806747 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-ceff8d48-4674-4691-8536-079ecdd14ee3 req-5552d7a9-2656-473a-8bbe-05da8b5a618c service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:18.807533 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-ceff8d48-4674-4691-8536-079ecdd14ee3 req-5552d7a9-2656-473a-8bbe-05da8b5a618c service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:18.835153 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.compute.server_external_events [req-ceff8d48-4674-4691-8536-079ecdd14ee3 req-5552d7a9-2656-473a-8bbe-05da8b5a618c service nova] Creating event network-vif-plugged:21924ff0-b505-4c58-b899-422df9458e67 for instance 91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1 on hv-cinder-zed-3 Oct 28 09:46:18.841800 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [req-ceff8d48-4674-4691-8536-079ecdd14ee3 req-5552d7a9-2656-473a-8bbe-05da8b5a618c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063823 Oct 28 09:46:18.842402 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 39/79] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Oct 28 09:46:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:46:18.869435 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-3d90a95a-c1e3-4631-b712-2fc8ee7c6a6a tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1a5347b8-5a75-4ddd-ae81-051c9568fc47"}} {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:46:18.872476 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-3d90a95a-c1e3-4631-b712-2fc8ee7c6a6a tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] [instance: 0c61b6b7-811a-4c77-ab85-d6eb319dd22e] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:46:18.879439 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-3d90a95a-c1e3-4631-b712-2fc8ee7c6a6a tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:18.880134 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-3d90a95a-c1e3-4631-b712-2fc8ee7c6a6a tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:18.880824 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-3d90a95a-c1e3-4631-b712-2fc8ee7c6a6a tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:18.881785 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-3d90a95a-c1e3-4631-b712-2fc8ee7c6a6a tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:18.882536 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-3d90a95a-c1e3-4631-b712-2fc8ee7c6a6a tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:18.883182 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-3d90a95a-c1e3-4631-b712-2fc8ee7c6a6a tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:19.146280 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-45887f64-1294-4176-acac-ad6819a8d5c0 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:46:19.147260 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-45887f64-1294-4176-acac-ad6819a8d5c0 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] [instance: 91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:46:19.159708 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-45887f64-1294-4176-acac-ad6819a8d5c0 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:19.160702 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-45887f64-1294-4176-acac-ad6819a8d5c0 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:19.160985 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-45887f64-1294-4176-acac-ad6819a8d5c0 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:19.163122 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-45887f64-1294-4176-acac-ad6819a8d5c0 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:19.163781 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-45887f64-1294-4176-acac-ad6819a8d5c0 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:19.168108 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-45887f64-1294-4176-acac-ad6819a8d5c0 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:19.466257 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-45887f64-1294-4176-acac-ad6819a8d5c0 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bee2d5f599642788c32e0d8b8338c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e7d531c0f4a33a869309af965e3e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:46:19.494940 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-45887f64-1294-4176-acac-ad6819a8d5c0 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] 10.222.0.52 "GET /compute/v2.1/servers/91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1" status: 200 len: 1362 microversion: 2.1 time: 0.352758 Oct 28 09:46:19.499559 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 40/80] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:46:19 2022] GET /compute/v2.1/servers/91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1 => generated 1362 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:46:19.585177 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-5cb0a498-e44c-4eea-9803-adaea0ae15a4 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:46:19.586576 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-5cb0a498-e44c-4eea-9803-adaea0ae15a4 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] [instance: 2427c17b-fdca-4f26-83bf-65e75775d4c4] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:46:19.594679 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-5cb0a498-e44c-4eea-9803-adaea0ae15a4 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:19.595348 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-5cb0a498-e44c-4eea-9803-adaea0ae15a4 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:19.597096 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-5cb0a498-e44c-4eea-9803-adaea0ae15a4 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:19.599317 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-5cb0a498-e44c-4eea-9803-adaea0ae15a4 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:19.599990 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-5cb0a498-e44c-4eea-9803-adaea0ae15a4 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:19.601301 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-5cb0a498-e44c-4eea-9803-adaea0ae15a4 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:19.745322 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-5cb0a498-e44c-4eea-9803-adaea0ae15a4 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30363c264f9b4ff5b5e17654bc3e9000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00b4ea7657d41e6a02531c3509619c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:46:19.786542 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-5cb0a498-e44c-4eea-9803-adaea0ae15a4 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] 10.222.0.52 "GET /compute/v2.1/servers/2427c17b-fdca-4f26-83bf-65e75775d4c4" status: 200 len: 1209 microversion: 2.1 time: 0.210347 Oct 28 09:46:19.806673 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 41/81] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:46:19 2022] GET /compute/v2.1/servers/2427c17b-fdca-4f26-83bf-65e75775d4c4 => generated 1209 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:46:19.831197 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-d8878f87-dc79-4848-bcb6-e9adbce4c544 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:46:19.834224 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-d8878f87-dc79-4848-bcb6-e9adbce4c544 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 6869ffb6-ce4f-4a91-b8d9-7765ea56e95a] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:46:19.849527 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-d8878f87-dc79-4848-bcb6-e9adbce4c544 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:19.850358 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-d8878f87-dc79-4848-bcb6-e9adbce4c544 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:19.850947 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-d8878f87-dc79-4848-bcb6-e9adbce4c544 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:19.851879 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-d8878f87-dc79-4848-bcb6-e9adbce4c544 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:19.852485 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-d8878f87-dc79-4848-bcb6-e9adbce4c544 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:19.853570 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-3d90a95a-c1e3-4631-b712-2fc8ee7c6a6a tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] 10.222.0.52 "POST /compute/v2.1/servers/0c61b6b7-811a-4c77-ab85-d6eb319dd22e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.990649 Oct 28 09:46:19.854356 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-d8878f87-dc79-4848-bcb6-e9adbce4c544 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:19.860249 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 41/82] 10.222.0.52 () {60 vars in 1323 bytes} [Fri Oct 28 09:46:18 2022] POST /compute/v2.1/servers/0c61b6b7-811a-4c77-ab85-d6eb319dd22e/os-volume_attachments => generated 194 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:46:20.131966 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-d8878f87-dc79-4848-bcb6-e9adbce4c544 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:46:20.144751 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-d8878f87-dc79-4848-bcb6-e9adbce4c544 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:46:20.146620 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-d8878f87-dc79-4848-bcb6-e9adbce4c544 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:46:20.150481 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-d8878f87-dc79-4848-bcb6-e9adbce4c544 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a" status: 200 len: 1405 microversion: 2.20 time: 0.330479 Oct 28 09:46:20.156574 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 42/83] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:46:19 2022] GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a => generated 1405 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:46:20.525303 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-2fd2d7a7-f50d-49fb-81f0-dc80590c0f37 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:46:20.526036 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-2fd2d7a7-f50d-49fb-81f0-dc80590c0f37 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] [instance: 91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:46:20.541035 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-2fd2d7a7-f50d-49fb-81f0-dc80590c0f37 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:20.541199 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-2fd2d7a7-f50d-49fb-81f0-dc80590c0f37 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:20.541643 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-2fd2d7a7-f50d-49fb-81f0-dc80590c0f37 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:20.542375 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-2fd2d7a7-f50d-49fb-81f0-dc80590c0f37 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:20.542845 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-2fd2d7a7-f50d-49fb-81f0-dc80590c0f37 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:20.543278 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-2fd2d7a7-f50d-49fb-81f0-dc80590c0f37 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:20.833801 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-0cd46684-895f-44c4-9bca-f804e515c430 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:46:20.835039 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-0cd46684-895f-44c4-9bca-f804e515c430 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] [instance: 2427c17b-fdca-4f26-83bf-65e75775d4c4] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:46:20.846177 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-0cd46684-895f-44c4-9bca-f804e515c430 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:20.846756 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-0cd46684-895f-44c4-9bca-f804e515c430 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:20.849788 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-0cd46684-895f-44c4-9bca-f804e515c430 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:20.851177 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-0cd46684-895f-44c4-9bca-f804e515c430 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:20.851835 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-0cd46684-895f-44c4-9bca-f804e515c430 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:20.852426 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-0cd46684-895f-44c4-9bca-f804e515c430 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:20.889941 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-2fd2d7a7-f50d-49fb-81f0-dc80590c0f37 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bee2d5f599642788c32e0d8b8338c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e7d531c0f4a33a869309af965e3e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:46:20.901398 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-2fd2d7a7-f50d-49fb-81f0-dc80590c0f37 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] 10.222.0.52 "GET /compute/v2.1/servers/91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1" status: 200 len: 1362 microversion: 2.1 time: 0.380928 Oct 28 09:46:20.903436 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 42/84] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:46:20 2022] GET /compute/v2.1/servers/91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1 => generated 1362 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:46:20.969493 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-0cd46684-895f-44c4-9bca-f804e515c430 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30363c264f9b4ff5b5e17654bc3e9000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00b4ea7657d41e6a02531c3509619c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:46:20.977336 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-0cd46684-895f-44c4-9bca-f804e515c430 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] 10.222.0.52 "GET /compute/v2.1/servers/2427c17b-fdca-4f26-83bf-65e75775d4c4" status: 200 len: 1265 microversion: 2.1 time: 0.147644 Oct 28 09:46:20.978385 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 43/85] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:46:20 2022] GET /compute/v2.1/servers/2427c17b-fdca-4f26-83bf-65e75775d4c4 => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:46:21.185121 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-0dd25b7d-cc2b-45c6-84db-40abc8b2ab0f tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:46:21.185828 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-0dd25b7d-cc2b-45c6-84db-40abc8b2ab0f tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 6869ffb6-ce4f-4a91-b8d9-7765ea56e95a] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:46:21.192638 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-0dd25b7d-cc2b-45c6-84db-40abc8b2ab0f tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:21.193218 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-0dd25b7d-cc2b-45c6-84db-40abc8b2ab0f tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:21.194277 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-0dd25b7d-cc2b-45c6-84db-40abc8b2ab0f tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:21.195080 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-0dd25b7d-cc2b-45c6-84db-40abc8b2ab0f tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:21.195626 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-0dd25b7d-cc2b-45c6-84db-40abc8b2ab0f tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:21.196007 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-0dd25b7d-cc2b-45c6-84db-40abc8b2ab0f tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:21.352397 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-0dd25b7d-cc2b-45c6-84db-40abc8b2ab0f tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:46:21.362099 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-0dd25b7d-cc2b-45c6-84db-40abc8b2ab0f tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:46:21.364041 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-0dd25b7d-cc2b-45c6-84db-40abc8b2ab0f tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:46:21.365479 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-0dd25b7d-cc2b-45c6-84db-40abc8b2ab0f tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a" status: 200 len: 1405 microversion: 2.20 time: 0.184237 Oct 28 09:46:21.366947 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 43/86] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:46:21 2022] GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a => generated 1405 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:46:21.927030 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-fa153763-a809-40b1-a501-61e1b2426c34 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:46:21.927672 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-fa153763-a809-40b1-a501-61e1b2426c34 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] [instance: 91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:46:21.934356 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-fa153763-a809-40b1-a501-61e1b2426c34 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:21.935041 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-fa153763-a809-40b1-a501-61e1b2426c34 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:21.935974 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-fa153763-a809-40b1-a501-61e1b2426c34 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:21.936729 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-fa153763-a809-40b1-a501-61e1b2426c34 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:21.937174 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-fa153763-a809-40b1-a501-61e1b2426c34 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:21.937773 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-fa153763-a809-40b1-a501-61e1b2426c34 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:22.009899 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-0fd0d4b3-9c68-4fd0-8077-0045d6167ead tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:46:22.010982 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-0fd0d4b3-9c68-4fd0-8077-0045d6167ead tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] [instance: 2427c17b-fdca-4f26-83bf-65e75775d4c4] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:46:22.023236 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-0fd0d4b3-9c68-4fd0-8077-0045d6167ead tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:22.023869 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-0fd0d4b3-9c68-4fd0-8077-0045d6167ead tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:22.026081 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-0fd0d4b3-9c68-4fd0-8077-0045d6167ead tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:22.026941 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-0fd0d4b3-9c68-4fd0-8077-0045d6167ead tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:22.029000 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-0fd0d4b3-9c68-4fd0-8077-0045d6167ead tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:22.029798 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-0fd0d4b3-9c68-4fd0-8077-0045d6167ead tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:22.142457 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-0fd0d4b3-9c68-4fd0-8077-0045d6167ead tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30363c264f9b4ff5b5e17654bc3e9000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00b4ea7657d41e6a02531c3509619c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:46:22.156822 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-0fd0d4b3-9c68-4fd0-8077-0045d6167ead tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] 10.222.0.52 "GET /compute/v2.1/servers/2427c17b-fdca-4f26-83bf-65e75775d4c4" status: 200 len: 1265 microversion: 2.1 time: 0.158032 Oct 28 09:46:22.157652 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 44/87] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:46:21 2022] GET /compute/v2.1/servers/2427c17b-fdca-4f26-83bf-65e75775d4c4 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:46:22.181265 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-fa153763-a809-40b1-a501-61e1b2426c34 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bee2d5f599642788c32e0d8b8338c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e7d531c0f4a33a869309af965e3e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:46:22.192211 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-fa153763-a809-40b1-a501-61e1b2426c34 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] 10.222.0.52 "GET /compute/v2.1/servers/91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1" status: 200 len: 1548 microversion: 2.1 time: 0.267846 Oct 28 09:46:22.193577 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 44/88] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:46:21 2022] GET /compute/v2.1/servers/91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1 => generated 1548 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:46:22.222431 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-824ebd6c-c11b-4747-b10d-82a68d045970 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:46:22.223256 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-824ebd6c-c11b-4747-b10d-82a68d045970 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] [instance: 91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:46:22.230186 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-824ebd6c-c11b-4747-b10d-82a68d045970 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:22.230715 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-824ebd6c-c11b-4747-b10d-82a68d045970 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:22.231156 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-824ebd6c-c11b-4747-b10d-82a68d045970 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:22.232000 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-824ebd6c-c11b-4747-b10d-82a68d045970 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:22.232478 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-824ebd6c-c11b-4747-b10d-82a68d045970 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:22.232888 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-824ebd6c-c11b-4747-b10d-82a68d045970 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:22.358326 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-824ebd6c-c11b-4747-b10d-82a68d045970 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] 10.222.0.52 "GET /compute/v2.1/servers/91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.142386 Oct 28 09:46:22.359125 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 45/89] 10.222.0.52 () {58 vars in 1275 bytes} [Fri Oct 28 09:46:22 2022] GET /compute/v2.1/servers/91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1/os-interface => generated 285 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:46:22.392512 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-7d4d6d79-9f51-4b6f-a1b0-50baca88b465 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:46:22.393448 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-7d4d6d79-9f51-4b6f-a1b0-50baca88b465 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 6869ffb6-ce4f-4a91-b8d9-7765ea56e95a] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:46:22.401984 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-7d4d6d79-9f51-4b6f-a1b0-50baca88b465 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:22.402465 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-7d4d6d79-9f51-4b6f-a1b0-50baca88b465 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:22.402890 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-7d4d6d79-9f51-4b6f-a1b0-50baca88b465 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:22.403575 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-7d4d6d79-9f51-4b6f-a1b0-50baca88b465 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:22.404055 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-7d4d6d79-9f51-4b6f-a1b0-50baca88b465 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:22.404473 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-7d4d6d79-9f51-4b6f-a1b0-50baca88b465 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:22.962792 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-7d4d6d79-9f51-4b6f-a1b0-50baca88b465 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:46:22.976361 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-7d4d6d79-9f51-4b6f-a1b0-50baca88b465 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:46:22.979516 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-7d4d6d79-9f51-4b6f-a1b0-50baca88b465 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:46:22.981053 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-7d4d6d79-9f51-4b6f-a1b0-50baca88b465 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a" status: 200 len: 1405 microversion: 2.20 time: 0.594383 Oct 28 09:46:22.981875 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 45/90] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:46:22 2022] GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a => generated 1405 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:46:23.032371 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [req-324a599b-fabe-444e-9de9-fbdcfca74100 req-22d68961-f704-4e71-9a78-7dc5de71e7bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6869ffb6-ce4f-4a91-b8d9-7765ea56e95a", "name": "network-vif-plugged", "status": "completed", "tag": "f350d1f8-ff54-4a77-b413-0023d0d49856"}]} {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:46:23.051689 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-324a599b-fabe-444e-9de9-fbdcfca74100 req-22d68961-f704-4e71-9a78-7dc5de71e7bc service nova] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:23.058993 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-324a599b-fabe-444e-9de9-fbdcfca74100 req-22d68961-f704-4e71-9a78-7dc5de71e7bc service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:23.059972 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-324a599b-fabe-444e-9de9-fbdcfca74100 req-22d68961-f704-4e71-9a78-7dc5de71e7bc service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:23.076710 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.compute.server_external_events [req-324a599b-fabe-444e-9de9-fbdcfca74100 req-22d68961-f704-4e71-9a78-7dc5de71e7bc service nova] Creating event network-vif-plugged:f350d1f8-ff54-4a77-b413-0023d0d49856 for instance 6869ffb6-ce4f-4a91-b8d9-7765ea56e95a on hv-cinder-zed-3 Oct 28 09:46:23.093192 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [req-324a599b-fabe-444e-9de9-fbdcfca74100 req-22d68961-f704-4e71-9a78-7dc5de71e7bc service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073678 Oct 28 09:46:23.094250 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 46/91] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Oct 28 09:46:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:46:23.197113 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-6d4b50dd-e778-481a-9d75-79f7151e13f7 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:46:23.197666 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-6d4b50dd-e778-481a-9d75-79f7151e13f7 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] [instance: 2427c17b-fdca-4f26-83bf-65e75775d4c4] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:46:23.212608 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-6d4b50dd-e778-481a-9d75-79f7151e13f7 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:23.213107 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-6d4b50dd-e778-481a-9d75-79f7151e13f7 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:23.213537 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-6d4b50dd-e778-481a-9d75-79f7151e13f7 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:23.214419 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-6d4b50dd-e778-481a-9d75-79f7151e13f7 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:23.216924 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-6d4b50dd-e778-481a-9d75-79f7151e13f7 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:23.217411 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-6d4b50dd-e778-481a-9d75-79f7151e13f7 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:23.380507 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-6d4b50dd-e778-481a-9d75-79f7151e13f7 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30363c264f9b4ff5b5e17654bc3e9000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00b4ea7657d41e6a02531c3509619c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:46:23.395277 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-6d4b50dd-e778-481a-9d75-79f7151e13f7 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] 10.222.0.52 "GET /compute/v2.1/servers/2427c17b-fdca-4f26-83bf-65e75775d4c4" status: 200 len: 1273 microversion: 2.1 time: 0.200367 Oct 28 09:46:23.395906 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 46/92] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:46:23 2022] GET /compute/v2.1/servers/2427c17b-fdca-4f26-83bf-65e75775d4c4 => generated 1273 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:46:24.017099 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-0244b5dd-82a7-4f79-bc83-98e08b58a38d tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:46:24.018014 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-0244b5dd-82a7-4f79-bc83-98e08b58a38d tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 6869ffb6-ce4f-4a91-b8d9-7765ea56e95a] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:46:24.043596 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-0244b5dd-82a7-4f79-bc83-98e08b58a38d tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:24.045232 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-0244b5dd-82a7-4f79-bc83-98e08b58a38d tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:24.047775 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-0244b5dd-82a7-4f79-bc83-98e08b58a38d tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:24.057503 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-0244b5dd-82a7-4f79-bc83-98e08b58a38d tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:24.058650 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-0244b5dd-82a7-4f79-bc83-98e08b58a38d tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:24.065416 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-0244b5dd-82a7-4f79-bc83-98e08b58a38d tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:24.311111 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-0244b5dd-82a7-4f79-bc83-98e08b58a38d tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:46:24.322114 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-0244b5dd-82a7-4f79-bc83-98e08b58a38d tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:46:24.324274 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-0244b5dd-82a7-4f79-bc83-98e08b58a38d tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:46:24.325717 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-0244b5dd-82a7-4f79-bc83-98e08b58a38d tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a" status: 200 len: 1405 microversion: 2.20 time: 0.315081 Oct 28 09:46:24.326375 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 47/93] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:46:24 2022] GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a => generated 1405 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:46:24.425033 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-628f33c4-17ca-492c-a96d-b2b3386a915c tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:46:24.426274 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-628f33c4-17ca-492c-a96d-b2b3386a915c tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] [instance: 2427c17b-fdca-4f26-83bf-65e75775d4c4] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:46:24.432964 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-628f33c4-17ca-492c-a96d-b2b3386a915c tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:24.433868 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-628f33c4-17ca-492c-a96d-b2b3386a915c tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:24.434996 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-628f33c4-17ca-492c-a96d-b2b3386a915c tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:24.435965 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-628f33c4-17ca-492c-a96d-b2b3386a915c tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:24.436562 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-628f33c4-17ca-492c-a96d-b2b3386a915c tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:24.437127 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-628f33c4-17ca-492c-a96d-b2b3386a915c tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:24.537100 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-628f33c4-17ca-492c-a96d-b2b3386a915c tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30363c264f9b4ff5b5e17654bc3e9000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00b4ea7657d41e6a02531c3509619c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:46:24.562455 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-628f33c4-17ca-492c-a96d-b2b3386a915c tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] 10.222.0.52 "GET /compute/v2.1/servers/2427c17b-fdca-4f26-83bf-65e75775d4c4" status: 200 len: 1271 microversion: 2.1 time: 0.141732 Oct 28 09:46:24.578264 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 47/94] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:46:24 2022] GET /compute/v2.1/servers/2427c17b-fdca-4f26-83bf-65e75775d4c4 => generated 1271 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:46:25.238556 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-79ea68b4-282d-468e-b0e3-d2a8c91919e3 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:46:25.239900 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-79ea68b4-282d-468e-b0e3-d2a8c91919e3 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] [instance: 0c61b6b7-811a-4c77-ab85-d6eb319dd22e] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:46:25.247669 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-79ea68b4-282d-468e-b0e3-d2a8c91919e3 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:25.248322 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-79ea68b4-282d-468e-b0e3-d2a8c91919e3 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:25.249051 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-79ea68b4-282d-468e-b0e3-d2a8c91919e3 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:25.250127 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-79ea68b4-282d-468e-b0e3-d2a8c91919e3 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:25.250738 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-79ea68b4-282d-468e-b0e3-d2a8c91919e3 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:25.251568 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-79ea68b4-282d-468e-b0e3-d2a8c91919e3 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:25.281808 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-79ea68b4-282d-468e-b0e3-d2a8c91919e3 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] [instance: 0c61b6b7-811a-4c77-ab85-d6eb319dd22e] Going to try to terminate instance {{(pid=127033) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 09:46:25.357382 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-4638efdf-94a8-4e76-971e-5ce0386e531b tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:46:25.358498 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-4638efdf-94a8-4e76-971e-5ce0386e531b tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 6869ffb6-ce4f-4a91-b8d9-7765ea56e95a] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:46:25.371486 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-4638efdf-94a8-4e76-971e-5ce0386e531b tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:25.372956 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-4638efdf-94a8-4e76-971e-5ce0386e531b tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:25.374893 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-4638efdf-94a8-4e76-971e-5ce0386e531b tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:25.376622 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-4638efdf-94a8-4e76-971e-5ce0386e531b tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:25.378023 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-4638efdf-94a8-4e76-971e-5ce0386e531b tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:25.383666 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-4638efdf-94a8-4e76-971e-5ce0386e531b tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:25.394620 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-79ea68b4-282d-468e-b0e3-d2a8c91919e3 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] 10.222.0.52 "DELETE /compute/v2.1/servers/0c61b6b7-811a-4c77-ab85-d6eb319dd22e" status: 204 len: 0 microversion: 2.1 time: 0.159699 Oct 28 09:46:25.396352 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 48/95] 10.222.0.52 () {58 vars in 1239 bytes} [Fri Oct 28 09:46:25 2022] DELETE /compute/v2.1/servers/0c61b6b7-811a-4c77-ab85-d6eb319dd22e => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 09:46:25.409776 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-5aec1c38-2049-4f2e-b68a-a6d62991380b tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:46:25.411429 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-5aec1c38-2049-4f2e-b68a-a6d62991380b tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] [instance: 0c61b6b7-811a-4c77-ab85-d6eb319dd22e] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:46:25.424613 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-5aec1c38-2049-4f2e-b68a-a6d62991380b tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:25.425315 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-5aec1c38-2049-4f2e-b68a-a6d62991380b tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:25.425937 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-5aec1c38-2049-4f2e-b68a-a6d62991380b tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:25.426799 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-5aec1c38-2049-4f2e-b68a-a6d62991380b tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:25.427647 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-5aec1c38-2049-4f2e-b68a-a6d62991380b tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:25.428905 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-5aec1c38-2049-4f2e-b68a-a6d62991380b tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:25.713395 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-4638efdf-94a8-4e76-971e-5ce0386e531b tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:46:25.728451 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-4638efdf-94a8-4e76-971e-5ce0386e531b tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:46:25.731719 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-4638efdf-94a8-4e76-971e-5ce0386e531b tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:46:25.733606 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-4638efdf-94a8-4e76-971e-5ce0386e531b tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a" status: 200 len: 1405 microversion: 2.20 time: 0.383320 Oct 28 09:46:25.735409 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 48/96] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:46:25 2022] GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a => generated 1405 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:46:25.742768 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [req-1b341687-70e6-4c05-8c55-bff18eac69e2 req-b1a53609-5ec4-469f-b479-33861a4e91cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1", "tag": "21924ff0-b505-4c58-b899-422df9458e67"}]} {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:46:25.754510 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-1b341687-70e6-4c05-8c55-bff18eac69e2 req-b1a53609-5ec4-469f-b479-33861a4e91cd service nova] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:25.755066 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-1b341687-70e6-4c05-8c55-bff18eac69e2 req-b1a53609-5ec4-469f-b479-33861a4e91cd service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:25.755503 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-1b341687-70e6-4c05-8c55-bff18eac69e2 req-b1a53609-5ec4-469f-b479-33861a4e91cd service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:25.771692 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.compute.server_external_events [req-1b341687-70e6-4c05-8c55-bff18eac69e2 req-b1a53609-5ec4-469f-b479-33861a4e91cd service nova] Creating event network-changed:21924ff0-b505-4c58-b899-422df9458e67 for instance 91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1 on hv-cinder-zed-3 Oct 28 09:46:25.780044 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [req-1b341687-70e6-4c05-8c55-bff18eac69e2 req-b1a53609-5ec4-469f-b479-33861a4e91cd service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042349 Oct 28 09:46:25.781416 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 49/97] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Oct 28 09:46:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:46:25.793978 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-e9690bcd-1a13-42b9-b610-92267cb5a417 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:46:25.794690 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-e9690bcd-1a13-42b9-b610-92267cb5a417 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] [instance: 2427c17b-fdca-4f26-83bf-65e75775d4c4] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:46:25.806173 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-e9690bcd-1a13-42b9-b610-92267cb5a417 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:25.807177 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-e9690bcd-1a13-42b9-b610-92267cb5a417 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:25.807600 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-e9690bcd-1a13-42b9-b610-92267cb5a417 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:25.808487 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-e9690bcd-1a13-42b9-b610-92267cb5a417 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:25.808852 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-e9690bcd-1a13-42b9-b610-92267cb5a417 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:25.809709 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-e9690bcd-1a13-42b9-b610-92267cb5a417 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:25.881424 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-5aec1c38-2049-4f2e-b68a-a6d62991380b tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e01f518dbd947bfafa6aecdccd9cfd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981def9b53d4448abde1baf030e5c63c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:46:25.894989 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-5aec1c38-2049-4f2e-b68a-a6d62991380b tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] 10.222.0.52 "GET /compute/v2.1/servers/0c61b6b7-811a-4c77-ab85-d6eb319dd22e" status: 200 len: 1555 microversion: 2.1 time: 0.492103 Oct 28 09:46:25.895841 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 49/98] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:46:25 2022] GET /compute/v2.1/servers/0c61b6b7-811a-4c77-ab85-d6eb319dd22e => generated 1555 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:46:26.162195 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-e9690bcd-1a13-42b9-b610-92267cb5a417 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30363c264f9b4ff5b5e17654bc3e9000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00b4ea7657d41e6a02531c3509619c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:46:26.171635 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-e9690bcd-1a13-42b9-b610-92267cb5a417 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] 10.222.0.52 "GET /compute/v2.1/servers/2427c17b-fdca-4f26-83bf-65e75775d4c4" status: 200 len: 1313 microversion: 2.1 time: 0.388732 Oct 28 09:46:26.175202 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 50/99] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:46:25 2022] GET /compute/v2.1/servers/2427c17b-fdca-4f26-83bf-65e75775d4c4 => generated 1313 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:46:26.785223 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-88cf0fda-d164-4728-aed9-ea37b1c77633 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:46:26.786247 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-88cf0fda-d164-4728-aed9-ea37b1c77633 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 6869ffb6-ce4f-4a91-b8d9-7765ea56e95a] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:46:26.804577 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-88cf0fda-d164-4728-aed9-ea37b1c77633 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:26.805458 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-88cf0fda-d164-4728-aed9-ea37b1c77633 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:26.806470 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-88cf0fda-d164-4728-aed9-ea37b1c77633 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:26.810987 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-88cf0fda-d164-4728-aed9-ea37b1c77633 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:26.811436 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-88cf0fda-d164-4728-aed9-ea37b1c77633 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:26.813231 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-88cf0fda-d164-4728-aed9-ea37b1c77633 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:26.921268 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-bdf2c73f-1f28-474a-9956-5092f45429f7 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:46:26.925221 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-bdf2c73f-1f28-474a-9956-5092f45429f7 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] [instance: 0c61b6b7-811a-4c77-ab85-d6eb319dd22e] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:46:26.955392 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-bdf2c73f-1f28-474a-9956-5092f45429f7 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:26.956965 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-bdf2c73f-1f28-474a-9956-5092f45429f7 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:26.957429 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-bdf2c73f-1f28-474a-9956-5092f45429f7 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:26.967056 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-bdf2c73f-1f28-474a-9956-5092f45429f7 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:26.968785 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-bdf2c73f-1f28-474a-9956-5092f45429f7 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:26.969314 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-bdf2c73f-1f28-474a-9956-5092f45429f7 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:27.179591 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG dbcounter [-] [127033] Writing DB stats nova_cell0:SELECT=4 {{(pid=127033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:46:27.250203 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-88cf0fda-d164-4728-aed9-ea37b1c77633 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:46:27.266439 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-88cf0fda-d164-4728-aed9-ea37b1c77633 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:46:27.270342 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-88cf0fda-d164-4728-aed9-ea37b1c77633 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:46:27.272909 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-88cf0fda-d164-4728-aed9-ea37b1c77633 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a" status: 200 len: 1405 microversion: 2.20 time: 0.493479 Oct 28 09:46:27.276218 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 50/100] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:46:26 2022] GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a => generated 1405 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:46:27.292285 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-4ff0b524-8374-42e1-8d25-1bf3c4e43ecd tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:46:27.293012 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-4ff0b524-8374-42e1-8d25-1bf3c4e43ecd tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] [instance: 2427c17b-fdca-4f26-83bf-65e75775d4c4] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:46:27.306495 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-4ff0b524-8374-42e1-8d25-1bf3c4e43ecd tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:27.307261 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-4ff0b524-8374-42e1-8d25-1bf3c4e43ecd tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:27.307847 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-4ff0b524-8374-42e1-8d25-1bf3c4e43ecd tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:27.308502 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-4ff0b524-8374-42e1-8d25-1bf3c4e43ecd tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:27.308956 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-4ff0b524-8374-42e1-8d25-1bf3c4e43ecd tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:27.309397 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-4ff0b524-8374-42e1-8d25-1bf3c4e43ecd tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:27.364921 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-bdf2c73f-1f28-474a-9956-5092f45429f7 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e01f518dbd947bfafa6aecdccd9cfd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981def9b53d4448abde1baf030e5c63c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:46:27.379669 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-bdf2c73f-1f28-474a-9956-5092f45429f7 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] 10.222.0.52 "GET /compute/v2.1/servers/0c61b6b7-811a-4c77-ab85-d6eb319dd22e" status: 200 len: 1555 microversion: 2.1 time: 0.464177 Oct 28 09:46:27.384941 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 51/101] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:46:26 2022] GET /compute/v2.1/servers/0c61b6b7-811a-4c77-ab85-d6eb319dd22e => generated 1555 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:46:27.399443 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG dbcounter [-] [127033] Writing DB stats nova_cell0:SELECT=8 {{(pid=127033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:46:27.530773 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-4ff0b524-8374-42e1-8d25-1bf3c4e43ecd tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30363c264f9b4ff5b5e17654bc3e9000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00b4ea7657d41e6a02531c3509619c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:46:27.540834 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-4ff0b524-8374-42e1-8d25-1bf3c4e43ecd tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] 10.222.0.52 "GET /compute/v2.1/servers/2427c17b-fdca-4f26-83bf-65e75775d4c4" status: 200 len: 1313 microversion: 2.1 time: 0.263545 Oct 28 09:46:27.541623 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 51/102] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:46:27 2022] GET /compute/v2.1/servers/2427c17b-fdca-4f26-83bf-65e75775d4c4 => generated 1313 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:46:27.819107 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [req-bb5c2d35-4414-412f-9905-b1ba7c73f6c0 req-35b9f4ed-0245-4ef0-802b-6177479e83c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2427c17b-fdca-4f26-83bf-65e75775d4c4", "tag": "5de59347-ed66-4e04-813e-1c1d294cf9ae"}]} {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:46:27.831420 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-bb5c2d35-4414-412f-9905-b1ba7c73f6c0 req-35b9f4ed-0245-4ef0-802b-6177479e83c7 service nova] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:27.832201 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-bb5c2d35-4414-412f-9905-b1ba7c73f6c0 req-35b9f4ed-0245-4ef0-802b-6177479e83c7 service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:27.832623 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-bb5c2d35-4414-412f-9905-b1ba7c73f6c0 req-35b9f4ed-0245-4ef0-802b-6177479e83c7 service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:27.849705 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.compute.server_external_events [req-bb5c2d35-4414-412f-9905-b1ba7c73f6c0 req-35b9f4ed-0245-4ef0-802b-6177479e83c7 service nova] Creating event network-changed:5de59347-ed66-4e04-813e-1c1d294cf9ae for instance 2427c17b-fdca-4f26-83bf-65e75775d4c4 on hv-cinder-zed-3 Oct 28 09:46:27.856250 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [req-bb5c2d35-4414-412f-9905-b1ba7c73f6c0 req-35b9f4ed-0245-4ef0-802b-6177479e83c7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040633 Oct 28 09:46:27.857247 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 52/103] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Oct 28 09:46:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:46:28.306077 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-e8a72e88-4822-4d38-9074-f81d5fe2833a tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:46:28.307613 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-e8a72e88-4822-4d38-9074-f81d5fe2833a tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 6869ffb6-ce4f-4a91-b8d9-7765ea56e95a] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:46:28.317945 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-e8a72e88-4822-4d38-9074-f81d5fe2833a tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:28.320759 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-e8a72e88-4822-4d38-9074-f81d5fe2833a tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:28.321455 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-e8a72e88-4822-4d38-9074-f81d5fe2833a tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:28.324146 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-e8a72e88-4822-4d38-9074-f81d5fe2833a tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:28.331572 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-e8a72e88-4822-4d38-9074-f81d5fe2833a tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:28.332772 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-e8a72e88-4822-4d38-9074-f81d5fe2833a tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:28.371776 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG dbcounter [-] [127033] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:46:28.416507 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-c69bb211-24da-426a-9ead-ac1afddeddf9 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:46:28.417398 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-c69bb211-24da-426a-9ead-ac1afddeddf9 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] [instance: 0c61b6b7-811a-4c77-ab85-d6eb319dd22e] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:46:28.430481 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-c69bb211-24da-426a-9ead-ac1afddeddf9 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:28.431183 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-c69bb211-24da-426a-9ead-ac1afddeddf9 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:28.433568 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-c69bb211-24da-426a-9ead-ac1afddeddf9 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:28.435321 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-c69bb211-24da-426a-9ead-ac1afddeddf9 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:28.436586 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-c69bb211-24da-426a-9ead-ac1afddeddf9 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:28.440689 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-c69bb211-24da-426a-9ead-ac1afddeddf9 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:28.632726 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-e8a72e88-4822-4d38-9074-f81d5fe2833a tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:46:28.646073 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-e8a72e88-4822-4d38-9074-f81d5fe2833a tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:46:28.648228 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-e8a72e88-4822-4d38-9074-f81d5fe2833a tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:46:28.651625 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-e8a72e88-4822-4d38-9074-f81d5fe2833a tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a" status: 200 len: 1595 microversion: 2.20 time: 0.349597 Oct 28 09:46:28.655861 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 52/104] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:46:28 2022] GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a => generated 1595 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:46:28.674077 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-3a20507b-00a6-457f-ac68-70c8f893bcf9 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:46:28.675023 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-3a20507b-00a6-457f-ac68-70c8f893bcf9 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] [instance: 2427c17b-fdca-4f26-83bf-65e75775d4c4] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:46:28.682056 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-3a20507b-00a6-457f-ac68-70c8f893bcf9 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:28.697396 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-3a20507b-00a6-457f-ac68-70c8f893bcf9 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:28.697870 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-3a20507b-00a6-457f-ac68-70c8f893bcf9 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:28.698617 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-3a20507b-00a6-457f-ac68-70c8f893bcf9 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:28.699081 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-3a20507b-00a6-457f-ac68-70c8f893bcf9 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:28.703945 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-3a20507b-00a6-457f-ac68-70c8f893bcf9 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:29.066179 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-c69bb211-24da-426a-9ead-ac1afddeddf9 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e01f518dbd947bfafa6aecdccd9cfd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981def9b53d4448abde1baf030e5c63c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:46:29.107521 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-c69bb211-24da-426a-9ead-ac1afddeddf9 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] 10.222.0.52 "GET /compute/v2.1/servers/0c61b6b7-811a-4c77-ab85-d6eb319dd22e" status: 200 len: 1555 microversion: 2.1 time: 0.693382 Oct 28 09:46:29.113977 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 53/105] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:46:28 2022] GET /compute/v2.1/servers/0c61b6b7-811a-4c77-ab85-d6eb319dd22e => generated 1555 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:46:29.178834 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-825a813d-d428-4d88-aad0-953fef6a787e tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:46:29.185129 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-825a813d-d428-4d88-aad0-953fef6a787e tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 6869ffb6-ce4f-4a91-b8d9-7765ea56e95a] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:46:29.236786 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-825a813d-d428-4d88-aad0-953fef6a787e tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:29.236786 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-825a813d-d428-4d88-aad0-953fef6a787e tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:29.238861 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-825a813d-d428-4d88-aad0-953fef6a787e tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:29.259655 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-825a813d-d428-4d88-aad0-953fef6a787e tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:29.259655 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-825a813d-d428-4d88-aad0-953fef6a787e tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:29.259655 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-825a813d-d428-4d88-aad0-953fef6a787e tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:29.426993 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-3a20507b-00a6-457f-ac68-70c8f893bcf9 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30363c264f9b4ff5b5e17654bc3e9000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00b4ea7657d41e6a02531c3509619c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:46:29.449590 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-3a20507b-00a6-457f-ac68-70c8f893bcf9 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] 10.222.0.52 "GET /compute/v2.1/servers/2427c17b-fdca-4f26-83bf-65e75775d4c4" status: 200 len: 1313 microversion: 2.1 time: 0.791960 Oct 28 09:46:29.463233 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 53/106] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:46:28 2022] GET /compute/v2.1/servers/2427c17b-fdca-4f26-83bf-65e75775d4c4 => generated 1313 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:46:29.624297 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-825a813d-d428-4d88-aad0-953fef6a787e tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.502169 Oct 28 09:46:29.625245 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 54/107] 10.222.0.52 () {60 vars in 1316 bytes} [Fri Oct 28 09:46:29 2022] GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a/os-interface => generated 284 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 09:46:30.145772 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-64543a53-fc60-4531-b0d1-bae380919af8 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:46:30.147527 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-64543a53-fc60-4531-b0d1-bae380919af8 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] [instance: 0c61b6b7-811a-4c77-ab85-d6eb319dd22e] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:46:30.161813 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-64543a53-fc60-4531-b0d1-bae380919af8 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:30.162315 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-64543a53-fc60-4531-b0d1-bae380919af8 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:30.163531 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-64543a53-fc60-4531-b0d1-bae380919af8 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:30.164505 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-64543a53-fc60-4531-b0d1-bae380919af8 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:30.165143 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-64543a53-fc60-4531-b0d1-bae380919af8 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:30.165720 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-64543a53-fc60-4531-b0d1-bae380919af8 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:30.494865 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-97557a76-ae1d-4fe7-8530-fb1b91e03a60 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:46:30.496833 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-97557a76-ae1d-4fe7-8530-fb1b91e03a60 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] [instance: 2427c17b-fdca-4f26-83bf-65e75775d4c4] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:46:30.507906 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-97557a76-ae1d-4fe7-8530-fb1b91e03a60 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:30.511499 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-97557a76-ae1d-4fe7-8530-fb1b91e03a60 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:30.515518 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-97557a76-ae1d-4fe7-8530-fb1b91e03a60 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:30.516692 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-97557a76-ae1d-4fe7-8530-fb1b91e03a60 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:30.523526 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-97557a76-ae1d-4fe7-8530-fb1b91e03a60 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:30.524320 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-97557a76-ae1d-4fe7-8530-fb1b91e03a60 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:30.962850 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-64543a53-fc60-4531-b0d1-bae380919af8 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e01f518dbd947bfafa6aecdccd9cfd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981def9b53d4448abde1baf030e5c63c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:46:30.976601 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-64543a53-fc60-4531-b0d1-bae380919af8 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] 10.222.0.52 "GET /compute/v2.1/servers/0c61b6b7-811a-4c77-ab85-d6eb319dd22e" status: 200 len: 1555 microversion: 2.1 time: 0.835317 Oct 28 09:46:30.979104 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 54/108] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:46:30 2022] GET /compute/v2.1/servers/0c61b6b7-811a-4c77-ab85-d6eb319dd22e => generated 1555 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:46:30.990308 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [req-defb2ed2-c8fc-4fd8-848c-ba23fe2e8715 req-1351026a-64c2-4333-8b95-c1dbc3053a09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c61b6b7-811a-4c77-ab85-d6eb319dd22e", "name": "network-vif-deleted", "tag": "9d73f353-d1c2-4f15-835d-d4a3b3feef41"}]} {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:46:31.026584 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-defb2ed2-c8fc-4fd8-848c-ba23fe2e8715 req-1351026a-64c2-4333-8b95-c1dbc3053a09 service nova] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:31.028744 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-defb2ed2-c8fc-4fd8-848c-ba23fe2e8715 req-1351026a-64c2-4333-8b95-c1dbc3053a09 service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:31.030291 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-defb2ed2-c8fc-4fd8-848c-ba23fe2e8715 req-1351026a-64c2-4333-8b95-c1dbc3053a09 service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:31.068354 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.compute.server_external_events [req-defb2ed2-c8fc-4fd8-848c-ba23fe2e8715 req-1351026a-64c2-4333-8b95-c1dbc3053a09 service nova] Creating event network-vif-deleted:9d73f353-d1c2-4f15-835d-d4a3b3feef41 for instance 0c61b6b7-811a-4c77-ab85-d6eb319dd22e on hv-cinder-zed-3 Oct 28 09:46:31.083617 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [req-defb2ed2-c8fc-4fd8-848c-ba23fe2e8715 req-1351026a-64c2-4333-8b95-c1dbc3053a09 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100864 Oct 28 09:46:31.088591 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 55/109] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Oct 28 09:46:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:46:31.201756 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-97557a76-ae1d-4fe7-8530-fb1b91e03a60 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30363c264f9b4ff5b5e17654bc3e9000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00b4ea7657d41e6a02531c3509619c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:46:31.204089 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG dbcounter [-] [127032] Writing DB stats nova_cell1:SELECT=100 {{(pid=127032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:46:31.216483 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-97557a76-ae1d-4fe7-8530-fb1b91e03a60 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] 10.222.0.52 "GET /compute/v2.1/servers/2427c17b-fdca-4f26-83bf-65e75775d4c4" status: 200 len: 1313 microversion: 2.1 time: 0.721562 Oct 28 09:46:31.217574 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 55/110] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:46:30 2022] GET /compute/v2.1/servers/2427c17b-fdca-4f26-83bf-65e75775d4c4 => generated 1313 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:46:32.009303 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-2432f7bf-2e3c-4e57-93f9-063c8a73fa59 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:46:32.010561 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-2432f7bf-2e3c-4e57-93f9-063c8a73fa59 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] [instance: 0c61b6b7-811a-4c77-ab85-d6eb319dd22e] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:46:32.018024 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG dbcounter [-] [127033] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:46:32.030203 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-2432f7bf-2e3c-4e57-93f9-063c8a73fa59 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:32.031670 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-2432f7bf-2e3c-4e57-93f9-063c8a73fa59 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:32.034710 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-2432f7bf-2e3c-4e57-93f9-063c8a73fa59 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:32.035717 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-2432f7bf-2e3c-4e57-93f9-063c8a73fa59 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:32.037017 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-2432f7bf-2e3c-4e57-93f9-063c8a73fa59 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:32.038349 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-2432f7bf-2e3c-4e57-93f9-063c8a73fa59 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:32.155978 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-2432f7bf-2e3c-4e57-93f9-063c8a73fa59 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e01f518dbd947bfafa6aecdccd9cfd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981def9b53d4448abde1baf030e5c63c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:46:32.183008 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-2432f7bf-2e3c-4e57-93f9-063c8a73fa59 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] 10.222.0.52 "GET /compute/v2.1/servers/0c61b6b7-811a-4c77-ab85-d6eb319dd22e" status: 200 len: 1513 microversion: 2.1 time: 0.179831 Oct 28 09:46:32.186528 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 56/111] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:46:32 2022] GET /compute/v2.1/servers/0c61b6b7-811a-4c77-ab85-d6eb319dd22e => generated 1513 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:46:32.243849 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-b16d89ef-518b-4d72-acc9-c483650b8db1 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:46:32.245065 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-b16d89ef-518b-4d72-acc9-c483650b8db1 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] [instance: 2427c17b-fdca-4f26-83bf-65e75775d4c4] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:46:32.247024 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG dbcounter [-] [127032] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=3 {{(pid=127032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:46:32.253671 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-b16d89ef-518b-4d72-acc9-c483650b8db1 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:32.254176 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-b16d89ef-518b-4d72-acc9-c483650b8db1 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:32.254602 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-b16d89ef-518b-4d72-acc9-c483650b8db1 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:32.255304 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-b16d89ef-518b-4d72-acc9-c483650b8db1 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:32.255775 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-b16d89ef-518b-4d72-acc9-c483650b8db1 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:32.258366 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-b16d89ef-518b-4d72-acc9-c483650b8db1 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:32.492551 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-b16d89ef-518b-4d72-acc9-c483650b8db1 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30363c264f9b4ff5b5e17654bc3e9000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00b4ea7657d41e6a02531c3509619c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:46:32.510296 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-b16d89ef-518b-4d72-acc9-c483650b8db1 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] 10.222.0.52 "GET /compute/v2.1/servers/2427c17b-fdca-4f26-83bf-65e75775d4c4" status: 200 len: 1313 microversion: 2.1 time: 0.270278 Oct 28 09:46:32.512236 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 56/112] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:46:32 2022] GET /compute/v2.1/servers/2427c17b-fdca-4f26-83bf-65e75775d4c4 => generated 1313 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:46:33.071826 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [req-a4e69a04-8580-4ed2-b13e-a3fb84596c31 req-0e2023fe-4e4f-4548-a230-42475bae37d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6869ffb6-ce4f-4a91-b8d9-7765ea56e95a", "tag": "f350d1f8-ff54-4a77-b413-0023d0d49856"}]} {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:46:33.145959 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-a4e69a04-8580-4ed2-b13e-a3fb84596c31 req-0e2023fe-4e4f-4548-a230-42475bae37d2 service nova] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:33.146799 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-a4e69a04-8580-4ed2-b13e-a3fb84596c31 req-0e2023fe-4e4f-4548-a230-42475bae37d2 service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:33.151897 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-a4e69a04-8580-4ed2-b13e-a3fb84596c31 req-0e2023fe-4e4f-4548-a230-42475bae37d2 service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:33.212810 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-1d656838-e866-4582-ab5e-5fc065942de8 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:46:33.213883 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-1d656838-e866-4582-ab5e-5fc065942de8 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] [instance: 0c61b6b7-811a-4c77-ab85-d6eb319dd22e] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:46:33.240137 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.compute.server_external_events [req-a4e69a04-8580-4ed2-b13e-a3fb84596c31 req-0e2023fe-4e4f-4548-a230-42475bae37d2 service nova] Creating event network-changed:f350d1f8-ff54-4a77-b413-0023d0d49856 for instance 6869ffb6-ce4f-4a91-b8d9-7765ea56e95a on hv-cinder-zed-3 Oct 28 09:46:33.254670 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-1d656838-e866-4582-ab5e-5fc065942de8 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:33.257386 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-1d656838-e866-4582-ab5e-5fc065942de8 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:33.258003 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [req-a4e69a04-8580-4ed2-b13e-a3fb84596c31 req-0e2023fe-4e4f-4548-a230-42475bae37d2 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.597820 Oct 28 09:46:33.258340 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-1d656838-e866-4582-ab5e-5fc065942de8 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:33.265111 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 57/113] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Oct 28 09:46:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:46:33.270763 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-1d656838-e866-4582-ab5e-5fc065942de8 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:33.274826 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-1d656838-e866-4582-ab5e-5fc065942de8 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:33.278725 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-1d656838-e866-4582-ab5e-5fc065942de8 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:33.538275 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-bfb8eea4-3336-4788-b02d-55017f7b1187 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:46:33.539052 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-bfb8eea4-3336-4788-b02d-55017f7b1187 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] [instance: 2427c17b-fdca-4f26-83bf-65e75775d4c4] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:46:33.546091 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-1d656838-e866-4582-ab5e-5fc065942de8 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e01f518dbd947bfafa6aecdccd9cfd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981def9b53d4448abde1baf030e5c63c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:46:33.557583 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-1d656838-e866-4582-ab5e-5fc065942de8 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] 10.222.0.52 "GET /compute/v2.1/servers/0c61b6b7-811a-4c77-ab85-d6eb319dd22e" status: 200 len: 1346 microversion: 2.1 time: 0.351816 Oct 28 09:46:33.574730 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 57/114] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:46:33 2022] GET /compute/v2.1/servers/0c61b6b7-811a-4c77-ab85-d6eb319dd22e => generated 1346 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:46:33.575288 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-bfb8eea4-3336-4788-b02d-55017f7b1187 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:33.575288 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-bfb8eea4-3336-4788-b02d-55017f7b1187 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:33.575288 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-bfb8eea4-3336-4788-b02d-55017f7b1187 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:33.575970 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-bfb8eea4-3336-4788-b02d-55017f7b1187 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:33.576438 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-bfb8eea4-3336-4788-b02d-55017f7b1187 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:33.576914 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-bfb8eea4-3336-4788-b02d-55017f7b1187 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:33.911455 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-bfb8eea4-3336-4788-b02d-55017f7b1187 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30363c264f9b4ff5b5e17654bc3e9000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00b4ea7657d41e6a02531c3509619c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:46:33.920019 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-bfb8eea4-3336-4788-b02d-55017f7b1187 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] 10.222.0.52 "GET /compute/v2.1/servers/2427c17b-fdca-4f26-83bf-65e75775d4c4" status: 200 len: 1313 microversion: 2.1 time: 0.387198 Oct 28 09:46:33.927792 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 58/115] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:46:33 2022] GET /compute/v2.1/servers/2427c17b-fdca-4f26-83bf-65e75775d4c4 => generated 1313 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:46:34.584213 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-8d58fb69-10e1-494b-9a3c-fbea9b36d0da tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:46:34.584984 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-8d58fb69-10e1-494b-9a3c-fbea9b36d0da tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] [instance: 0c61b6b7-811a-4c77-ab85-d6eb319dd22e] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:46:34.599134 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-8d58fb69-10e1-494b-9a3c-fbea9b36d0da tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:34.599633 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-8d58fb69-10e1-494b-9a3c-fbea9b36d0da tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:34.600694 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-8d58fb69-10e1-494b-9a3c-fbea9b36d0da tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:34.604930 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-8d58fb69-10e1-494b-9a3c-fbea9b36d0da tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:34.605432 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-8d58fb69-10e1-494b-9a3c-fbea9b36d0da tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:34.605868 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-8d58fb69-10e1-494b-9a3c-fbea9b36d0da tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:34.665243 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.wsgi [None req-8d58fb69-10e1-494b-9a3c-fbea9b36d0da tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] HTTP exception thrown: Instance 0c61b6b7-811a-4c77-ab85-d6eb319dd22e could not be found. Oct 28 09:46:34.687453 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-8d58fb69-10e1-494b-9a3c-fbea9b36d0da tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Request method failure captured: Oct 28 09:46:34.687453 dv-cinder-zed-3-smb devstack@n-api.service[127032]: request: GET /compute/v2.1/servers/0c61b6b7-811a-4c77-ab85-d6eb319dd22e HTTP/1.1 Oct 28 09:46:34.687453 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Accept: application/json Oct 28 09:46:34.687453 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Accept-Encoding: identity Oct 28 09:46:34.687453 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Connection: close Oct 28 09:46:34.687453 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Content-Length: 0 Oct 28 09:46:34.687453 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Content-Type: application/json Oct 28 09:46:34.687453 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Host: 10.222.0.52 Oct 28 09:46:34.687453 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Openstack-System-Scope: None Oct 28 09:46:34.687453 dv-cinder-zed-3-smb devstack@n-api.service[127032]: User-Agent: python-urllib3/1.26.12 Oct 28 09:46:34.687453 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Auth-Token: gAAAAABjW6S8h6pxqhVRtDz4EJ7O3FIt4WK6KLg1nkbeZ2lIYaVJqOvL6pqBCXqdvsd0zRIuJzSnYP5YpHEM-4b_vpChe5AYeiI7H_9sDeEyCuoGkr-PHbbAbBFdXMNAClyhwxGmJQipvHyzxoSAydfSiloKkGcJJX_Fjy4l356CUEGheDWwNUk Oct 28 09:46:34.687453 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Domain-Id: None Oct 28 09:46:34.687453 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Domain-Name: None Oct 28 09:46:34.687453 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Identity-Status: Confirmed Oct 28 09:46:34.687453 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Is-Admin-Project: True Oct 28 09:46:34.687453 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Project-Domain-Id: default Oct 28 09:46:34.687453 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Project-Domain-Name: Default Oct 28 09:46:34.687453 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Project-Id: 981def9b53d4448abde1baf030e5c63c Oct 28 09:46:34.687453 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Project-Name: tempest-DeleteServersTestJSON-1014926402 Oct 28 09:46:34.687453 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Role: reader,member Oct 28 09:46:34.687453 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Roles: reader,member Oct 28 09:46:34.688967 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_981def9b53d4448abde1baf030e5c63c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/981def9b53d4448abde1baf030e5c63c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/981def9b53d4448abde1baf030e5c63c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/981def9b53d4448abde1baf030e5c63c"}]}] Oct 28 09:46:34.688967 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Tenant: tempest-DeleteServersTestJSON-1014926402 Oct 28 09:46:34.688967 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Tenant-Id: 981def9b53d4448abde1baf030e5c63c Oct 28 09:46:34.688967 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Tenant-Name: tempest-DeleteServersTestJSON-1014926402 Oct 28 09:46:34.688967 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-User: tempest-DeleteServersTestJSON-1014926402-project Oct 28 09:46:34.688967 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-User-Domain-Id: default Oct 28 09:46:34.688967 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-User-Domain-Name: Default Oct 28 09:46:34.688967 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-User-Id: 5e01f518dbd947bfafa6aecdccd9cfd5 Oct 28 09:46:34.688967 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-User-Name: tempest-DeleteServersTestJSON-1014926402-project Oct 28 09:46:34.688967 dv-cinder-zed-3-smb devstack@n-api.service[127032]: method: > Oct 28 09:46:34.688967 dv-cinder-zed-3-smb devstack@n-api.service[127032]: exception: Instance 0c61b6b7-811a-4c77-ab85-d6eb319dd22e could not be found. Oct 28 09:46:34.688967 dv-cinder-zed-3-smb devstack@n-api.service[127032]: action_args: {'id': '0c61b6b7-811a-4c77-ab85-d6eb319dd22e'} Oct 28 09:46:34.689738 dv-cinder-zed-3-smb devstack@n-api.service[127032]: {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:46:34.689738 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:46:34.689738 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 09:46:34.689738 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 09:46:34.689738 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 09:46:34.689738 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 09:46:34.689738 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 09:46:34.689738 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 09:46:34.689738 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 09:46:34.689738 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 09:46:34.689738 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c61b6b7-811a-4c77-ab85-d6eb319dd22e could not be found. Oct 28 09:46:34.689738 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Oct 28 09:46:34.689738 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:46:34.689738 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Oct 28 09:46:34.689738 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:46:34.689738 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:46:34.689738 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:46:34.689738 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:46:34.689738 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:46:34.689738 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:46:34.691017 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:46:34.691017 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 09:46:34.691017 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 09:46:34.691017 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 09:46:34.691017 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 09:46:34.691017 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 09:46:34.691017 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 09:46:34.691017 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c61b6b7-811a-4c77-ab85-d6eb319dd22e could not be found. Oct 28 09:46:34.691017 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Oct 28 09:46:34.691017 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:46:34.691017 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Oct 28 09:46:34.691017 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:46:34.691017 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:46:34.691017 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:46:34.691017 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:46:34.691017 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:46:34.691017 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c61b6b7-811a-4c77-ab85-d6eb319dd22e could not be found. Oct 28 09:46:34.691017 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Oct 28 09:46:34.695103 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-8d58fb69-10e1-494b-9a3c-fbea9b36d0da tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Returning 404 to user: Instance 0c61b6b7-811a-4c77-ab85-d6eb319dd22e could not be found. {{(pid=127032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:46:34.696491 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-8d58fb69-10e1-494b-9a3c-fbea9b36d0da tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] 10.222.0.52 "GET /compute/v2.1/servers/0c61b6b7-811a-4c77-ab85-d6eb319dd22e" status: 404 len: 111 microversion: 2.1 time: 0.117563 Oct 28 09:46:34.698515 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 58/116] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:46:34 2022] GET /compute/v2.1/servers/0c61b6b7-811a-4c77-ab85-d6eb319dd22e => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:46:34.857670 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-ed800d00-5ecd-404c-b242-164be156d10b tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:46:34.860833 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-ed800d00-5ecd-404c-b242-164be156d10b tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] [instance: 0c61b6b7-811a-4c77-ab85-d6eb319dd22e] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:46:34.869193 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-ed800d00-5ecd-404c-b242-164be156d10b tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:34.870233 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-ed800d00-5ecd-404c-b242-164be156d10b tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:34.871105 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-ed800d00-5ecd-404c-b242-164be156d10b tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:34.872372 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-ed800d00-5ecd-404c-b242-164be156d10b tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:34.873120 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-ed800d00-5ecd-404c-b242-164be156d10b tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:34.873810 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-ed800d00-5ecd-404c-b242-164be156d10b tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:34.890107 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.wsgi [None req-ed800d00-5ecd-404c-b242-164be156d10b tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] HTTP exception thrown: Instance 0c61b6b7-811a-4c77-ab85-d6eb319dd22e could not be found. Oct 28 09:46:34.906990 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-ed800d00-5ecd-404c-b242-164be156d10b tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Request method failure captured: Oct 28 09:46:34.906990 dv-cinder-zed-3-smb devstack@n-api.service[127033]: request: GET /compute/v2.1/servers/0c61b6b7-811a-4c77-ab85-d6eb319dd22e/os-volume_attachments HTTP/1.1 Oct 28 09:46:34.906990 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Accept: application/json Oct 28 09:46:34.906990 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Accept-Encoding: identity Oct 28 09:46:34.906990 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Connection: close Oct 28 09:46:34.906990 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Content-Length: 0 Oct 28 09:46:34.906990 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Content-Type: application/json Oct 28 09:46:34.906990 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Host: 10.222.0.52 Oct 28 09:46:34.906990 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Openstack-System-Scope: None Oct 28 09:46:34.906990 dv-cinder-zed-3-smb devstack@n-api.service[127033]: User-Agent: python-urllib3/1.26.12 Oct 28 09:46:34.906990 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Auth-Token: gAAAAABjW6S8h6pxqhVRtDz4EJ7O3FIt4WK6KLg1nkbeZ2lIYaVJqOvL6pqBCXqdvsd0zRIuJzSnYP5YpHEM-4b_vpChe5AYeiI7H_9sDeEyCuoGkr-PHbbAbBFdXMNAClyhwxGmJQipvHyzxoSAydfSiloKkGcJJX_Fjy4l356CUEGheDWwNUk Oct 28 09:46:34.906990 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Domain-Id: None Oct 28 09:46:34.906990 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Domain-Name: None Oct 28 09:46:34.906990 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Identity-Status: Confirmed Oct 28 09:46:34.906990 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Is-Admin-Project: True Oct 28 09:46:34.906990 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Project-Domain-Id: default Oct 28 09:46:34.906990 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Project-Domain-Name: Default Oct 28 09:46:34.906990 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Project-Id: 981def9b53d4448abde1baf030e5c63c Oct 28 09:46:34.906990 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Project-Name: tempest-DeleteServersTestJSON-1014926402 Oct 28 09:46:34.906990 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Role: reader,member Oct 28 09:46:34.906990 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Roles: reader,member Oct 28 09:46:34.908398 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_981def9b53d4448abde1baf030e5c63c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/981def9b53d4448abde1baf030e5c63c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/981def9b53d4448abde1baf030e5c63c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/981def9b53d4448abde1baf030e5c63c"}]}] Oct 28 09:46:34.908398 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Tenant: tempest-DeleteServersTestJSON-1014926402 Oct 28 09:46:34.908398 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Tenant-Id: 981def9b53d4448abde1baf030e5c63c Oct 28 09:46:34.908398 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Tenant-Name: tempest-DeleteServersTestJSON-1014926402 Oct 28 09:46:34.908398 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User: tempest-DeleteServersTestJSON-1014926402-project Oct 28 09:46:34.908398 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User-Domain-Id: default Oct 28 09:46:34.908398 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User-Domain-Name: Default Oct 28 09:46:34.908398 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User-Id: 5e01f518dbd947bfafa6aecdccd9cfd5 Oct 28 09:46:34.908398 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User-Name: tempest-DeleteServersTestJSON-1014926402-project Oct 28 09:46:34.908398 dv-cinder-zed-3-smb devstack@n-api.service[127033]: method: > Oct 28 09:46:34.908398 dv-cinder-zed-3-smb devstack@n-api.service[127033]: exception: Instance 0c61b6b7-811a-4c77-ab85-d6eb319dd22e could not be found. Oct 28 09:46:34.908398 dv-cinder-zed-3-smb devstack@n-api.service[127033]: action_args: {'server_id': '0c61b6b7-811a-4c77-ab85-d6eb319dd22e'} Oct 28 09:46:34.909177 dv-cinder-zed-3-smb devstack@n-api.service[127033]: {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:46:34.909177 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:46:34.909177 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 09:46:34.909177 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 09:46:34.909177 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 09:46:34.909177 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 09:46:34.909177 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 09:46:34.909177 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 09:46:34.909177 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 09:46:34.909177 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 09:46:34.909177 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c61b6b7-811a-4c77-ab85-d6eb319dd22e could not be found. Oct 28 09:46:34.909177 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:46:34.909177 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:46:34.909177 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:46:34.909177 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:46:34.909177 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:46:34.909177 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:46:34.909177 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:46:34.909177 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:46:34.909177 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:46:34.910821 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:46:34.910821 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 28 09:46:34.910821 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 09:46:34.910821 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 28 09:46:34.910821 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 09:46:34.910821 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 28 09:46:34.910821 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 28 09:46:34.910821 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 09:46:34.910821 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 09:46:34.910821 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c61b6b7-811a-4c77-ab85-d6eb319dd22e could not be found. Oct 28 09:46:34.910821 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:46:34.910821 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:46:34.910821 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:46:34.910821 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:46:34.910821 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:46:34.910821 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:46:34.910821 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:46:34.910821 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:46:34.910821 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c61b6b7-811a-4c77-ab85-d6eb319dd22e could not be found. Oct 28 09:46:34.910821 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:46:34.916540 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-ed800d00-5ecd-404c-b242-164be156d10b tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Returning 404 to user: Instance 0c61b6b7-811a-4c77-ab85-d6eb319dd22e could not be found. {{(pid=127033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:46:34.918208 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-ed800d00-5ecd-404c-b242-164be156d10b tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] 10.222.0.52 "GET /compute/v2.1/servers/0c61b6b7-811a-4c77-ab85-d6eb319dd22e/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.064941 Oct 28 09:46:34.918775 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 59/117] 10.222.0.52 () {58 vars in 1302 bytes} [Fri Oct 28 09:46:34 2022] GET /compute/v2.1/servers/0c61b6b7-811a-4c77-ab85-d6eb319dd22e/os-volume_attachments => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:46:34.947240 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-64a2f733-93a0-4f56-9ab7-f03bc5e6d749 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:46:34.948535 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-64a2f733-93a0-4f56-9ab7-f03bc5e6d749 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] [instance: 2427c17b-fdca-4f26-83bf-65e75775d4c4] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:46:34.961035 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-64a2f733-93a0-4f56-9ab7-f03bc5e6d749 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:34.962412 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-64a2f733-93a0-4f56-9ab7-f03bc5e6d749 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:34.963908 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-64a2f733-93a0-4f56-9ab7-f03bc5e6d749 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:34.965672 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-64a2f733-93a0-4f56-9ab7-f03bc5e6d749 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:34.967438 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-64a2f733-93a0-4f56-9ab7-f03bc5e6d749 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:34.970816 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-64a2f733-93a0-4f56-9ab7-f03bc5e6d749 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:35.203301 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-64a2f733-93a0-4f56-9ab7-f03bc5e6d749 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30363c264f9b4ff5b5e17654bc3e9000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00b4ea7657d41e6a02531c3509619c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:46:35.214806 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-64a2f733-93a0-4f56-9ab7-f03bc5e6d749 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] 10.222.0.52 "GET /compute/v2.1/servers/2427c17b-fdca-4f26-83bf-65e75775d4c4" status: 200 len: 1313 microversion: 2.1 time: 0.273390 Oct 28 09:46:35.215078 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [req-c2ae77eb-e25c-4077-9ee2-bb3021565c7d req-be7115d3-8cb8-46c9-aeec-80edfddd0de8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2427c17b-fdca-4f26-83bf-65e75775d4c4", "name": "network-vif-plugged", "status": "completed", "tag": "5de59347-ed66-4e04-813e-1c1d294cf9ae"}]} {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:46:35.227811 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 59/118] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:46:34 2022] GET /compute/v2.1/servers/2427c17b-fdca-4f26-83bf-65e75775d4c4 => generated 1313 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:46:35.240127 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-c2ae77eb-e25c-4077-9ee2-bb3021565c7d req-be7115d3-8cb8-46c9-aeec-80edfddd0de8 service nova] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:35.242471 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-c2ae77eb-e25c-4077-9ee2-bb3021565c7d req-be7115d3-8cb8-46c9-aeec-80edfddd0de8 service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:35.243197 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-c2ae77eb-e25c-4077-9ee2-bb3021565c7d req-be7115d3-8cb8-46c9-aeec-80edfddd0de8 service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:35.259896 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.compute.server_external_events [req-c2ae77eb-e25c-4077-9ee2-bb3021565c7d req-be7115d3-8cb8-46c9-aeec-80edfddd0de8 service nova] Creating event network-vif-plugged:5de59347-ed66-4e04-813e-1c1d294cf9ae for instance 2427c17b-fdca-4f26-83bf-65e75775d4c4 on hv-cinder-zed-3 Oct 28 09:46:35.266856 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [req-c2ae77eb-e25c-4077-9ee2-bb3021565c7d req-be7115d3-8cb8-46c9-aeec-80edfddd0de8 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058532 Oct 28 09:46:35.268379 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 60/119] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Oct 28 09:46:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:46:36.239119 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-ea39fb47-f213-4bda-bc6e-adb8adaf6ef8 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:46:36.239797 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-ea39fb47-f213-4bda-bc6e-adb8adaf6ef8 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] [instance: 2427c17b-fdca-4f26-83bf-65e75775d4c4] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:46:36.246836 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ea39fb47-f213-4bda-bc6e-adb8adaf6ef8 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:36.247331 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ea39fb47-f213-4bda-bc6e-adb8adaf6ef8 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:36.248144 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ea39fb47-f213-4bda-bc6e-adb8adaf6ef8 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:36.248589 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ea39fb47-f213-4bda-bc6e-adb8adaf6ef8 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:36.248937 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ea39fb47-f213-4bda-bc6e-adb8adaf6ef8 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:36.249419 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ea39fb47-f213-4bda-bc6e-adb8adaf6ef8 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:36.282480 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-1e8d8774-62af-4b21-8fe6-d69cac5fcb32 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:46:36.283724 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-1e8d8774-62af-4b21-8fe6-d69cac5fcb32 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] [instance: 0c61b6b7-811a-4c77-ab85-d6eb319dd22e] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:46:36.293599 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-1e8d8774-62af-4b21-8fe6-d69cac5fcb32 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:36.294045 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-1e8d8774-62af-4b21-8fe6-d69cac5fcb32 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:36.294783 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-1e8d8774-62af-4b21-8fe6-d69cac5fcb32 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:36.295673 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-1e8d8774-62af-4b21-8fe6-d69cac5fcb32 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:36.296207 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-1e8d8774-62af-4b21-8fe6-d69cac5fcb32 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:36.296634 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-1e8d8774-62af-4b21-8fe6-d69cac5fcb32 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:36.311999 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.wsgi [None req-1e8d8774-62af-4b21-8fe6-d69cac5fcb32 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] HTTP exception thrown: Instance 0c61b6b7-811a-4c77-ab85-d6eb319dd22e could not be found. Oct 28 09:46:36.314328 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-1e8d8774-62af-4b21-8fe6-d69cac5fcb32 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Request method failure captured: Oct 28 09:46:36.314328 dv-cinder-zed-3-smb devstack@n-api.service[127033]: request: DELETE /compute/v2.1/servers/0c61b6b7-811a-4c77-ab85-d6eb319dd22e HTTP/1.1 Oct 28 09:46:36.314328 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Accept: application/json Oct 28 09:46:36.314328 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Accept-Encoding: identity Oct 28 09:46:36.314328 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Connection: close Oct 28 09:46:36.314328 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Content-Length: 0 Oct 28 09:46:36.314328 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Content-Type: application/json Oct 28 09:46:36.314328 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Host: 10.222.0.52 Oct 28 09:46:36.314328 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Openstack-System-Scope: None Oct 28 09:46:36.314328 dv-cinder-zed-3-smb devstack@n-api.service[127033]: User-Agent: python-urllib3/1.26.12 Oct 28 09:46:36.314328 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Auth-Token: gAAAAABjW6S8h6pxqhVRtDz4EJ7O3FIt4WK6KLg1nkbeZ2lIYaVJqOvL6pqBCXqdvsd0zRIuJzSnYP5YpHEM-4b_vpChe5AYeiI7H_9sDeEyCuoGkr-PHbbAbBFdXMNAClyhwxGmJQipvHyzxoSAydfSiloKkGcJJX_Fjy4l356CUEGheDWwNUk Oct 28 09:46:36.314328 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Domain-Id: None Oct 28 09:46:36.314328 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Domain-Name: None Oct 28 09:46:36.314328 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Identity-Status: Confirmed Oct 28 09:46:36.314328 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Is-Admin-Project: True Oct 28 09:46:36.314328 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Project-Domain-Id: default Oct 28 09:46:36.314328 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Project-Domain-Name: Default Oct 28 09:46:36.314328 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Project-Id: 981def9b53d4448abde1baf030e5c63c Oct 28 09:46:36.314328 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Project-Name: tempest-DeleteServersTestJSON-1014926402 Oct 28 09:46:36.314328 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Role: reader,member Oct 28 09:46:36.314328 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Roles: reader,member Oct 28 09:46:36.320222 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_981def9b53d4448abde1baf030e5c63c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/981def9b53d4448abde1baf030e5c63c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/981def9b53d4448abde1baf030e5c63c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/981def9b53d4448abde1baf030e5c63c"}]}] Oct 28 09:46:36.320222 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Tenant: tempest-DeleteServersTestJSON-1014926402 Oct 28 09:46:36.320222 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Tenant-Id: 981def9b53d4448abde1baf030e5c63c Oct 28 09:46:36.320222 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Tenant-Name: tempest-DeleteServersTestJSON-1014926402 Oct 28 09:46:36.320222 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User: tempest-DeleteServersTestJSON-1014926402-project Oct 28 09:46:36.320222 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User-Domain-Id: default Oct 28 09:46:36.320222 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User-Domain-Name: Default Oct 28 09:46:36.320222 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User-Id: 5e01f518dbd947bfafa6aecdccd9cfd5 Oct 28 09:46:36.320222 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User-Name: tempest-DeleteServersTestJSON-1014926402-project Oct 28 09:46:36.320222 dv-cinder-zed-3-smb devstack@n-api.service[127033]: method: > Oct 28 09:46:36.320222 dv-cinder-zed-3-smb devstack@n-api.service[127033]: exception: Instance 0c61b6b7-811a-4c77-ab85-d6eb319dd22e could not be found. Oct 28 09:46:36.320222 dv-cinder-zed-3-smb devstack@n-api.service[127033]: action_args: {'id': '0c61b6b7-811a-4c77-ab85-d6eb319dd22e'} Oct 28 09:46:36.320931 dv-cinder-zed-3-smb devstack@n-api.service[127033]: {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:46:36.320931 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:46:36.320931 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 09:46:36.320931 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 09:46:36.320931 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 09:46:36.320931 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 09:46:36.320931 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 09:46:36.320931 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 09:46:36.320931 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 09:46:36.320931 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 09:46:36.320931 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c61b6b7-811a-4c77-ab85-d6eb319dd22e could not be found. Oct 28 09:46:36.320931 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:46:36.320931 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:46:36.320931 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:46:36.320931 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:46:36.320931 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:46:36.320931 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:46:36.320931 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:46:36.320931 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:46:36.320931 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:46:36.322154 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:46:36.322154 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 09:46:36.322154 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 09:46:36.322154 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 09:46:36.322154 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 09:46:36.322154 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 09:46:36.322154 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 09:46:36.322154 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 09:46:36.322154 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 09:46:36.322154 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c61b6b7-811a-4c77-ab85-d6eb319dd22e could not be found. Oct 28 09:46:36.322154 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:46:36.322154 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:46:36.322154 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:46:36.322154 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:46:36.322154 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:46:36.322154 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:46:36.322154 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:46:36.322154 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:46:36.322154 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c61b6b7-811a-4c77-ab85-d6eb319dd22e could not be found. Oct 28 09:46:36.322154 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:46:36.323775 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-1e8d8774-62af-4b21-8fe6-d69cac5fcb32 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Returning 404 to user: Instance 0c61b6b7-811a-4c77-ab85-d6eb319dd22e could not be found. {{(pid=127033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:46:36.323775 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-1e8d8774-62af-4b21-8fe6-d69cac5fcb32 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] 10.222.0.52 "DELETE /compute/v2.1/servers/0c61b6b7-811a-4c77-ab85-d6eb319dd22e" status: 404 len: 111 microversion: 2.1 time: 0.040342 Oct 28 09:46:36.323775 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 61/120] 10.222.0.52 () {58 vars in 1239 bytes} [Fri Oct 28 09:46:36 2022] DELETE /compute/v2.1/servers/0c61b6b7-811a-4c77-ab85-d6eb319dd22e => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 09:46:36.326833 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-41b0c295-c69f-4597-a0e8-3578db3947d6 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:46:36.327440 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-41b0c295-c69f-4597-a0e8-3578db3947d6 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] [instance: 0c61b6b7-811a-4c77-ab85-d6eb319dd22e] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:46:36.334776 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-41b0c295-c69f-4597-a0e8-3578db3947d6 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:36.335384 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-41b0c295-c69f-4597-a0e8-3578db3947d6 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:36.335986 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-41b0c295-c69f-4597-a0e8-3578db3947d6 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:36.336707 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-41b0c295-c69f-4597-a0e8-3578db3947d6 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:36.337236 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-41b0c295-c69f-4597-a0e8-3578db3947d6 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:36.337655 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-41b0c295-c69f-4597-a0e8-3578db3947d6 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:36.353464 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.wsgi [None req-41b0c295-c69f-4597-a0e8-3578db3947d6 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] HTTP exception thrown: Instance 0c61b6b7-811a-4c77-ab85-d6eb319dd22e could not be found. Oct 28 09:46:36.355002 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-41b0c295-c69f-4597-a0e8-3578db3947d6 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Request method failure captured: Oct 28 09:46:36.355002 dv-cinder-zed-3-smb devstack@n-api.service[127033]: request: GET /compute/v2.1/servers/0c61b6b7-811a-4c77-ab85-d6eb319dd22e HTTP/1.1 Oct 28 09:46:36.355002 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Accept: application/json Oct 28 09:46:36.355002 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Accept-Encoding: identity Oct 28 09:46:36.355002 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Connection: close Oct 28 09:46:36.355002 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Content-Length: 0 Oct 28 09:46:36.355002 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Content-Type: application/json Oct 28 09:46:36.355002 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Host: 10.222.0.52 Oct 28 09:46:36.355002 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Openstack-System-Scope: None Oct 28 09:46:36.355002 dv-cinder-zed-3-smb devstack@n-api.service[127033]: User-Agent: python-urllib3/1.26.12 Oct 28 09:46:36.355002 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Auth-Token: gAAAAABjW6S8h6pxqhVRtDz4EJ7O3FIt4WK6KLg1nkbeZ2lIYaVJqOvL6pqBCXqdvsd0zRIuJzSnYP5YpHEM-4b_vpChe5AYeiI7H_9sDeEyCuoGkr-PHbbAbBFdXMNAClyhwxGmJQipvHyzxoSAydfSiloKkGcJJX_Fjy4l356CUEGheDWwNUk Oct 28 09:46:36.355002 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Domain-Id: None Oct 28 09:46:36.355002 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Domain-Name: None Oct 28 09:46:36.355002 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Identity-Status: Confirmed Oct 28 09:46:36.355002 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Is-Admin-Project: True Oct 28 09:46:36.355002 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Project-Domain-Id: default Oct 28 09:46:36.355002 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Project-Domain-Name: Default Oct 28 09:46:36.355002 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Project-Id: 981def9b53d4448abde1baf030e5c63c Oct 28 09:46:36.355002 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Project-Name: tempest-DeleteServersTestJSON-1014926402 Oct 28 09:46:36.355002 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Role: reader,member Oct 28 09:46:36.355002 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Roles: reader,member Oct 28 09:46:36.356633 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_981def9b53d4448abde1baf030e5c63c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/981def9b53d4448abde1baf030e5c63c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/981def9b53d4448abde1baf030e5c63c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/981def9b53d4448abde1baf030e5c63c"}]}] Oct 28 09:46:36.356633 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Tenant: tempest-DeleteServersTestJSON-1014926402 Oct 28 09:46:36.356633 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Tenant-Id: 981def9b53d4448abde1baf030e5c63c Oct 28 09:46:36.356633 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Tenant-Name: tempest-DeleteServersTestJSON-1014926402 Oct 28 09:46:36.356633 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User: tempest-DeleteServersTestJSON-1014926402-project Oct 28 09:46:36.356633 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User-Domain-Id: default Oct 28 09:46:36.356633 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User-Domain-Name: Default Oct 28 09:46:36.356633 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User-Id: 5e01f518dbd947bfafa6aecdccd9cfd5 Oct 28 09:46:36.356633 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User-Name: tempest-DeleteServersTestJSON-1014926402-project Oct 28 09:46:36.356633 dv-cinder-zed-3-smb devstack@n-api.service[127033]: method: > Oct 28 09:46:36.356633 dv-cinder-zed-3-smb devstack@n-api.service[127033]: exception: Instance 0c61b6b7-811a-4c77-ab85-d6eb319dd22e could not be found. Oct 28 09:46:36.356633 dv-cinder-zed-3-smb devstack@n-api.service[127033]: action_args: {'id': '0c61b6b7-811a-4c77-ab85-d6eb319dd22e'} Oct 28 09:46:36.357426 dv-cinder-zed-3-smb devstack@n-api.service[127033]: {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:46:36.357426 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:46:36.357426 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 09:46:36.357426 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 09:46:36.357426 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 09:46:36.357426 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 09:46:36.357426 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 09:46:36.357426 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 09:46:36.357426 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 09:46:36.357426 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 09:46:36.357426 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c61b6b7-811a-4c77-ab85-d6eb319dd22e could not be found. Oct 28 09:46:36.357426 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:46:36.357426 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:46:36.357426 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:46:36.357426 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:46:36.357426 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:46:36.357426 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:46:36.357426 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:46:36.357426 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:46:36.357426 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:46:36.358607 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:46:36.358607 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 09:46:36.358607 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 09:46:36.358607 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 09:46:36.358607 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 09:46:36.358607 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 09:46:36.358607 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 09:46:36.358607 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c61b6b7-811a-4c77-ab85-d6eb319dd22e could not be found. Oct 28 09:46:36.358607 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:46:36.358607 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:46:36.358607 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:46:36.358607 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:46:36.358607 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:46:36.358607 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:46:36.358607 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:46:36.358607 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:46:36.358607 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c61b6b7-811a-4c77-ab85-d6eb319dd22e could not be found. Oct 28 09:46:36.358607 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:46:36.359772 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-41b0c295-c69f-4597-a0e8-3578db3947d6 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] Returning 404 to user: Instance 0c61b6b7-811a-4c77-ab85-d6eb319dd22e could not be found. {{(pid=127033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:46:36.359772 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-41b0c295-c69f-4597-a0e8-3578db3947d6 tempest-DeleteServersTestJSON-1014926402 tempest-DeleteServersTestJSON-1014926402-project] 10.222.0.52 "GET /compute/v2.1/servers/0c61b6b7-811a-4c77-ab85-d6eb319dd22e" status: 404 len: 111 microversion: 2.1 time: 0.034987 Oct 28 09:46:36.359772 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 62/121] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:46:36 2022] GET /compute/v2.1/servers/0c61b6b7-811a-4c77-ab85-d6eb319dd22e => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:46:36.452445 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-ea39fb47-f213-4bda-bc6e-adb8adaf6ef8 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30363c264f9b4ff5b5e17654bc3e9000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00b4ea7657d41e6a02531c3509619c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:46:36.460888 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-ea39fb47-f213-4bda-bc6e-adb8adaf6ef8 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] 10.222.0.52 "GET /compute/v2.1/servers/2427c17b-fdca-4f26-83bf-65e75775d4c4" status: 200 len: 1313 microversion: 2.1 time: 0.225714 Oct 28 09:46:36.461473 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 60/122] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:46:36 2022] GET /compute/v2.1/servers/2427c17b-fdca-4f26-83bf-65e75775d4c4 => generated 1313 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:46:37.493669 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-4dda78c8-1ee3-4a0a-bbfe-471101c6cfc4 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:46:37.496364 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-4dda78c8-1ee3-4a0a-bbfe-471101c6cfc4 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] [instance: 2427c17b-fdca-4f26-83bf-65e75775d4c4] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:46:37.512376 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-4dda78c8-1ee3-4a0a-bbfe-471101c6cfc4 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:37.513587 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-4dda78c8-1ee3-4a0a-bbfe-471101c6cfc4 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:37.514931 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-4dda78c8-1ee3-4a0a-bbfe-471101c6cfc4 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:37.516580 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-4dda78c8-1ee3-4a0a-bbfe-471101c6cfc4 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:37.518056 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-4dda78c8-1ee3-4a0a-bbfe-471101c6cfc4 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:37.519570 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-4dda78c8-1ee3-4a0a-bbfe-471101c6cfc4 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:37.892446 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-4dda78c8-1ee3-4a0a-bbfe-471101c6cfc4 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30363c264f9b4ff5b5e17654bc3e9000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00b4ea7657d41e6a02531c3509619c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:46:37.894333 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-4dda78c8-1ee3-4a0a-bbfe-471101c6cfc4 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] 10.222.0.52 "GET /compute/v2.1/servers/2427c17b-fdca-4f26-83bf-65e75775d4c4" status: 200 len: 1497 microversion: 2.1 time: 0.408796 Oct 28 09:46:37.896522 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 63/123] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:46:37 2022] GET /compute/v2.1/servers/2427c17b-fdca-4f26-83bf-65e75775d4c4 => generated 1497 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:46:42.211835 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-79c0c286-505d-4dcd-8dd9-226f6d7a5cc1 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:46:42.212361 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-79c0c286-505d-4dcd-8dd9-226f6d7a5cc1 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] [instance: 2427c17b-fdca-4f26-83bf-65e75775d4c4] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:46:42.218874 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-79c0c286-505d-4dcd-8dd9-226f6d7a5cc1 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:42.219497 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-79c0c286-505d-4dcd-8dd9-226f6d7a5cc1 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:42.220138 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-79c0c286-505d-4dcd-8dd9-226f6d7a5cc1 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:42.221029 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-79c0c286-505d-4dcd-8dd9-226f6d7a5cc1 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:42.221456 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-79c0c286-505d-4dcd-8dd9-226f6d7a5cc1 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:42.222029 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-79c0c286-505d-4dcd-8dd9-226f6d7a5cc1 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:42.258398 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-79c0c286-505d-4dcd-8dd9-226f6d7a5cc1 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] [instance: 2427c17b-fdca-4f26-83bf-65e75775d4c4] Going to try to terminate instance {{(pid=127032) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 09:46:42.412442 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-79c0c286-505d-4dcd-8dd9-226f6d7a5cc1 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] 10.222.0.52 "DELETE /compute/v2.1/servers/2427c17b-fdca-4f26-83bf-65e75775d4c4" status: 204 len: 0 microversion: 2.1 time: 0.204727 Oct 28 09:46:42.417354 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 61/124] 10.222.0.52 () {58 vars in 1239 bytes} [Fri Oct 28 09:46:42 2022] DELETE /compute/v2.1/servers/2427c17b-fdca-4f26-83bf-65e75775d4c4 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 09:46:42.423242 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-4cd60a4c-5e6c-44be-90a5-8172c68113b1 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:46:42.423962 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-4cd60a4c-5e6c-44be-90a5-8172c68113b1 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] [instance: 2427c17b-fdca-4f26-83bf-65e75775d4c4] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:46:42.435736 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-4cd60a4c-5e6c-44be-90a5-8172c68113b1 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:42.436686 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-4cd60a4c-5e6c-44be-90a5-8172c68113b1 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:42.438258 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-4cd60a4c-5e6c-44be-90a5-8172c68113b1 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:42.440260 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-4cd60a4c-5e6c-44be-90a5-8172c68113b1 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:42.441103 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-4cd60a4c-5e6c-44be-90a5-8172c68113b1 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:42.441604 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-4cd60a4c-5e6c-44be-90a5-8172c68113b1 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:42.674213 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-4cd60a4c-5e6c-44be-90a5-8172c68113b1 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30363c264f9b4ff5b5e17654bc3e9000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00b4ea7657d41e6a02531c3509619c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:46:42.687349 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-4cd60a4c-5e6c-44be-90a5-8172c68113b1 tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] 10.222.0.52 "GET /compute/v2.1/servers/2427c17b-fdca-4f26-83bf-65e75775d4c4" status: 200 len: 1503 microversion: 2.1 time: 0.268940 Oct 28 09:46:42.688641 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 64/125] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:46:42 2022] GET /compute/v2.1/servers/2427c17b-fdca-4f26-83bf-65e75775d4c4 => generated 1503 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:46:43.714025 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-9ed5ff5c-fdc8-44b5-8db1-0e1fd01e8f3f tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:46:43.714724 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-9ed5ff5c-fdc8-44b5-8db1-0e1fd01e8f3f tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] [instance: 2427c17b-fdca-4f26-83bf-65e75775d4c4] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:46:43.735201 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-9ed5ff5c-fdc8-44b5-8db1-0e1fd01e8f3f tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:43.737135 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-9ed5ff5c-fdc8-44b5-8db1-0e1fd01e8f3f tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:43.737577 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-9ed5ff5c-fdc8-44b5-8db1-0e1fd01e8f3f tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:43.738293 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-9ed5ff5c-fdc8-44b5-8db1-0e1fd01e8f3f tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:43.741753 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-9ed5ff5c-fdc8-44b5-8db1-0e1fd01e8f3f tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:43.742190 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-9ed5ff5c-fdc8-44b5-8db1-0e1fd01e8f3f tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:43.929013 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-9ed5ff5c-fdc8-44b5-8db1-0e1fd01e8f3f tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30363c264f9b4ff5b5e17654bc3e9000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00b4ea7657d41e6a02531c3509619c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:46:43.941062 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-9ed5ff5c-fdc8-44b5-8db1-0e1fd01e8f3f tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] 10.222.0.52 "GET /compute/v2.1/servers/2427c17b-fdca-4f26-83bf-65e75775d4c4" status: 200 len: 1503 microversion: 2.1 time: 0.232325 Oct 28 09:46:43.948937 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 62/126] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:46:43 2022] GET /compute/v2.1/servers/2427c17b-fdca-4f26-83bf-65e75775d4c4 => generated 1503 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:46:44.969852 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-6659e97b-e7b9-4cd4-9266-fa38e855a58b tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:46:44.972319 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-6659e97b-e7b9-4cd4-9266-fa38e855a58b tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] [instance: 2427c17b-fdca-4f26-83bf-65e75775d4c4] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:46:44.986194 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-6659e97b-e7b9-4cd4-9266-fa38e855a58b tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:44.987517 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-6659e97b-e7b9-4cd4-9266-fa38e855a58b tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:44.988597 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-6659e97b-e7b9-4cd4-9266-fa38e855a58b tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:44.990107 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-6659e97b-e7b9-4cd4-9266-fa38e855a58b tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:44.990977 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-6659e97b-e7b9-4cd4-9266-fa38e855a58b tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:44.992012 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-6659e97b-e7b9-4cd4-9266-fa38e855a58b tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:45.116954 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [req-20e8cbd1-7b5d-4407-aecf-36686c401feb req-4ba2acf1-100d-4634-803e-8b93a29cc588 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2427c17b-fdca-4f26-83bf-65e75775d4c4", "name": "network-vif-deleted", "tag": "5de59347-ed66-4e04-813e-1c1d294cf9ae"}]} {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:46:45.128866 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-20e8cbd1-7b5d-4407-aecf-36686c401feb req-4ba2acf1-100d-4634-803e-8b93a29cc588 service nova] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:45.129475 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-20e8cbd1-7b5d-4407-aecf-36686c401feb req-4ba2acf1-100d-4634-803e-8b93a29cc588 service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:45.129596 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-6659e97b-e7b9-4cd4-9266-fa38e855a58b tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30363c264f9b4ff5b5e17654bc3e9000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00b4ea7657d41e6a02531c3509619c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:46:45.130095 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-20e8cbd1-7b5d-4407-aecf-36686c401feb req-4ba2acf1-100d-4634-803e-8b93a29cc588 service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:45.140758 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-6659e97b-e7b9-4cd4-9266-fa38e855a58b tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] 10.222.0.52 "GET /compute/v2.1/servers/2427c17b-fdca-4f26-83bf-65e75775d4c4" status: 200 len: 1461 microversion: 2.1 time: 0.178698 Oct 28 09:46:45.141369 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 65/127] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:46:44 2022] GET /compute/v2.1/servers/2427c17b-fdca-4f26-83bf-65e75775d4c4 => generated 1461 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:46:45.143209 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.compute.server_external_events [req-20e8cbd1-7b5d-4407-aecf-36686c401feb req-4ba2acf1-100d-4634-803e-8b93a29cc588 service nova] Creating event network-vif-deleted:5de59347-ed66-4e04-813e-1c1d294cf9ae for instance 2427c17b-fdca-4f26-83bf-65e75775d4c4 on hv-cinder-zed-3 Oct 28 09:46:45.150166 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [req-20e8cbd1-7b5d-4407-aecf-36686c401feb req-4ba2acf1-100d-4634-803e-8b93a29cc588 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036736 Oct 28 09:46:45.154825 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 63/128] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Oct 28 09:46:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 09:46:46.165817 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-93731ed1-9196-4b85-8734-c9c785baf18c tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:46:46.166475 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-93731ed1-9196-4b85-8734-c9c785baf18c tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] [instance: 2427c17b-fdca-4f26-83bf-65e75775d4c4] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:46:46.180117 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-93731ed1-9196-4b85-8734-c9c785baf18c tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:46.180604 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-93731ed1-9196-4b85-8734-c9c785baf18c tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:46.181391 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-93731ed1-9196-4b85-8734-c9c785baf18c tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:46.182311 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-93731ed1-9196-4b85-8734-c9c785baf18c tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:46.182914 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-93731ed1-9196-4b85-8734-c9c785baf18c tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:46.183482 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-93731ed1-9196-4b85-8734-c9c785baf18c tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:46.200200 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.wsgi [None req-93731ed1-9196-4b85-8734-c9c785baf18c tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] HTTP exception thrown: Instance 2427c17b-fdca-4f26-83bf-65e75775d4c4 could not be found. Oct 28 09:46:46.201947 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-93731ed1-9196-4b85-8734-c9c785baf18c tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Request method failure captured: Oct 28 09:46:46.201947 dv-cinder-zed-3-smb devstack@n-api.service[127033]: request: GET /compute/v2.1/servers/2427c17b-fdca-4f26-83bf-65e75775d4c4 HTTP/1.1 Oct 28 09:46:46.201947 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Accept: application/json Oct 28 09:46:46.201947 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Accept-Encoding: identity Oct 28 09:46:46.201947 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Connection: close Oct 28 09:46:46.201947 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Content-Length: 0 Oct 28 09:46:46.201947 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Content-Type: application/json Oct 28 09:46:46.201947 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Host: 10.222.0.52 Oct 28 09:46:46.201947 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Openstack-System-Scope: None Oct 28 09:46:46.201947 dv-cinder-zed-3-smb devstack@n-api.service[127033]: User-Agent: python-urllib3/1.26.12 Oct 28 09:46:46.201947 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Auth-Token: gAAAAABjW6Tl7dHVo02FgRhQc6AqVAXdpEIbtA107S5BTgnXwFpByCOxAk4E7fPgh4WujoUyDjmbqDS7YlQrcOtT-B9hS6W1WzAkeVaBoO9viiG65euUbp3PboYcyMGzItt6r_5n3dTtaO1MdHU7uY_r8TXJZJenYldRVebH1BRM0FD_ZBB1T5Q Oct 28 09:46:46.201947 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Domain-Id: None Oct 28 09:46:46.201947 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Domain-Name: None Oct 28 09:46:46.201947 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Identity-Status: Confirmed Oct 28 09:46:46.201947 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Is-Admin-Project: True Oct 28 09:46:46.201947 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Project-Domain-Id: default Oct 28 09:46:46.201947 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Project-Domain-Name: Default Oct 28 09:46:46.201947 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Project-Id: d00b4ea7657d41e6a02531c3509619c9 Oct 28 09:46:46.201947 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Project-Name: tempest-VolumesActionsTest-1595854027 Oct 28 09:46:46.201947 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Role: reader,member Oct 28 09:46:46.201947 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Roles: reader,member Oct 28 09:46:46.203379 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d00b4ea7657d41e6a02531c3509619c9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d00b4ea7657d41e6a02531c3509619c9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d00b4ea7657d41e6a02531c3509619c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d00b4ea7657d41e6a02531c3509619c9"}]}] Oct 28 09:46:46.203379 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Tenant: tempest-VolumesActionsTest-1595854027 Oct 28 09:46:46.203379 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Tenant-Id: d00b4ea7657d41e6a02531c3509619c9 Oct 28 09:46:46.203379 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Tenant-Name: tempest-VolumesActionsTest-1595854027 Oct 28 09:46:46.203379 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User: tempest-VolumesActionsTest-1595854027-project Oct 28 09:46:46.203379 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User-Domain-Id: default Oct 28 09:46:46.203379 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User-Domain-Name: Default Oct 28 09:46:46.203379 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User-Id: 30363c264f9b4ff5b5e17654bc3e9000 Oct 28 09:46:46.203379 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User-Name: tempest-VolumesActionsTest-1595854027-project Oct 28 09:46:46.203379 dv-cinder-zed-3-smb devstack@n-api.service[127033]: method: > Oct 28 09:46:46.203379 dv-cinder-zed-3-smb devstack@n-api.service[127033]: exception: Instance 2427c17b-fdca-4f26-83bf-65e75775d4c4 could not be found. Oct 28 09:46:46.203379 dv-cinder-zed-3-smb devstack@n-api.service[127033]: action_args: {'id': '2427c17b-fdca-4f26-83bf-65e75775d4c4'} Oct 28 09:46:46.204412 dv-cinder-zed-3-smb devstack@n-api.service[127033]: {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:46:46.204412 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:46:46.204412 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 09:46:46.204412 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 09:46:46.204412 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 09:46:46.204412 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 09:46:46.204412 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 09:46:46.204412 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 09:46:46.204412 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 09:46:46.204412 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 09:46:46.204412 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2427c17b-fdca-4f26-83bf-65e75775d4c4 could not be found. Oct 28 09:46:46.204412 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:46:46.204412 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:46:46.204412 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:46:46.204412 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:46:46.204412 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:46:46.204412 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:46:46.204412 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:46:46.204412 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:46:46.204412 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:46:46.205742 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:46:46.205742 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 09:46:46.205742 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 09:46:46.205742 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 09:46:46.205742 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 09:46:46.205742 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 09:46:46.205742 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 09:46:46.205742 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2427c17b-fdca-4f26-83bf-65e75775d4c4 could not be found. Oct 28 09:46:46.205742 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:46:46.205742 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:46:46.205742 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:46:46.205742 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:46:46.205742 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:46:46.205742 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:46:46.205742 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:46:46.205742 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:46:46.205742 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2427c17b-fdca-4f26-83bf-65e75775d4c4 could not be found. Oct 28 09:46:46.205742 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:46:46.207851 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-93731ed1-9196-4b85-8734-c9c785baf18c tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] Returning 404 to user: Instance 2427c17b-fdca-4f26-83bf-65e75775d4c4 could not be found. {{(pid=127033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:46:46.209380 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-93731ed1-9196-4b85-8734-c9c785baf18c tempest-VolumesActionsTest-1595854027 tempest-VolumesActionsTest-1595854027-project] 10.222.0.52 "GET /compute/v2.1/servers/2427c17b-fdca-4f26-83bf-65e75775d4c4" status: 404 len: 111 microversion: 2.1 time: 0.047583 Oct 28 09:46:46.214046 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 66/129] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:46:46 2022] GET /compute/v2.1/servers/2427c17b-fdca-4f26-83bf-65e75775d4c4 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:46:53.094289 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-e98ff170-bbd4-4ee8-b491-a4cd9937b54d tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1754892467", "imageRef": "6e314146-a2ed-4f8b-afdd-4f7ed1184d20", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:46:53.202522 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.network.neutron [None req-e98ff170-bbd4-4ee8-b491-a4cd9937b54d tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] validate_networks() for [('5c41d975-aca9-4f42-800d-41513480bec7', None, None, None, None, None)] {{(pid=127032) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 09:46:53.763012 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.virt.hardware [None req-e98ff170-bbd4-4ee8-b491-a4cd9937b54d tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Flavor limits 0:0:0 {{(pid=127032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 09:46:53.763434 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.virt.hardware [None req-e98ff170-bbd4-4ee8-b491-a4cd9937b54d tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Image limits 0:0:0 {{(pid=127032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 09:46:53.763934 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.virt.hardware [None req-e98ff170-bbd4-4ee8-b491-a4cd9937b54d tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Flavor pref 0:0:0 {{(pid=127032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 09:46:53.764616 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.virt.hardware [None req-e98ff170-bbd4-4ee8-b491-a4cd9937b54d tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Image pref 0:0:0 {{(pid=127032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 09:46:53.765248 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.virt.hardware [None req-e98ff170-bbd4-4ee8-b491-a4cd9937b54d tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 09:46:53.776146 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-e98ff170-bbd4-4ee8-b491-a4cd9937b54d tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:53.776881 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-e98ff170-bbd4-4ee8-b491-a4cd9937b54d tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:53.777473 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-e98ff170-bbd4-4ee8-b491-a4cd9937b54d tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:53.778411 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-e98ff170-bbd4-4ee8-b491-a4cd9937b54d tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:53.779242 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-e98ff170-bbd4-4ee8-b491-a4cd9937b54d tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:53.779944 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-e98ff170-bbd4-4ee8-b491-a4cd9937b54d tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:53.800693 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.quota [None req-e98ff170-bbd4-4ee8-b491-a4cd9937b54d tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Getting quotas for project 234f69f21d7a456a9ab6a86c4ac2ede2. Resources: {'cores', 'ram', 'instances'} {{(pid=127032) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 09:46:53.807351 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.quota [None req-e98ff170-bbd4-4ee8-b491-a4cd9937b54d tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Getting quotas for user cfe6eb38e8df492daaef5755ddea7773 and project 234f69f21d7a456a9ab6a86c4ac2ede2. Resources: {'cores', 'ram', 'instances'} {{(pid=127032) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 09:46:53.826100 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-e98ff170-bbd4-4ee8-b491-a4cd9937b54d tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Going to run 1 instances... {{(pid=127032) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 09:46:53.829896 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-e98ff170-bbd4-4ee8-b491-a4cd9937b54d tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: 1eaf7cc8-63d3-40c6-b5f5-e4e978ddfe17] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e314146-a2ed-4f8b-afdd-4f7ed1184d20',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127032) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 09:46:53.886777 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-e98ff170-bbd4-4ee8-b491-a4cd9937b54d tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.019983 Oct 28 09:46:53.887859 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 64/130] 10.222.0.52 () {60 vars in 1147 bytes} [Fri Oct 28 09:46:52 2022] POST /compute/v2.1/servers => generated 383 bytes in 1023 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 09:46:53.904357 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-2fdae1b8-8bd7-4613-80ba-f603973afd17 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:46:53.905002 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-2fdae1b8-8bd7-4613-80ba-f603973afd17 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: 1eaf7cc8-63d3-40c6-b5f5-e4e978ddfe17] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:46:54.043130 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-2fdae1b8-8bd7-4613-80ba-f603973afd17 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe6eb38e8df492daaef5755ddea7773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234f69f21d7a456a9ab6a86c4ac2ede2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:46:54.050435 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-2fdae1b8-8bd7-4613-80ba-f603973afd17 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] 10.222.0.52 "GET /compute/v2.1/servers/1eaf7cc8-63d3-40c6-b5f5-e4e978ddfe17" status: 200 len: 1222 microversion: 2.1 time: 0.155445 Oct 28 09:46:54.055425 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 67/131] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:46:53 2022] GET /compute/v2.1/servers/1eaf7cc8-63d3-40c6-b5f5-e4e978ddfe17 => generated 1222 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:46:54.241792 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-a99bab3d-11da-4f23-965a-6b774ea968d2 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-674879309", "imageRef": "6e314146-a2ed-4f8b-afdd-4f7ed1184d20", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:46:58.600603 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.network.neutron [None req-a99bab3d-11da-4f23-965a-6b774ea968d2 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] validate_networks() for [('5c41d975-aca9-4f42-800d-41513480bec7', None, None, None, None, None)] {{(pid=127032) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 09:46:58.909992 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [req-25ec2032-bb57-4d28-96d2-05b9b86760c0 req-5e373f84-ad8a-4cc1-b563-cc86cf743176 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1eaf7cc8-63d3-40c6-b5f5-e4e978ddfe17", "tag": "598d1cbf-c937-4e8e-b9ab-10c22cbd11e8"}]} {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:46:58.933736 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG dbcounter [-] [127033] Writing DB stats nova_cell1:SELECT=59 {{(pid=127033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:46:58.936171 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-25ec2032-bb57-4d28-96d2-05b9b86760c0 req-5e373f84-ad8a-4cc1-b563-cc86cf743176 service nova] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:58.939372 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-25ec2032-bb57-4d28-96d2-05b9b86760c0 req-5e373f84-ad8a-4cc1-b563-cc86cf743176 service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:58.945894 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-25ec2032-bb57-4d28-96d2-05b9b86760c0 req-5e373f84-ad8a-4cc1-b563-cc86cf743176 service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:58.963863 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.compute.server_external_events [req-25ec2032-bb57-4d28-96d2-05b9b86760c0 req-5e373f84-ad8a-4cc1-b563-cc86cf743176 service nova] Creating event network-changed:598d1cbf-c937-4e8e-b9ab-10c22cbd11e8 for instance 1eaf7cc8-63d3-40c6-b5f5-e4e978ddfe17 on hv-cinder-zed-3 Oct 28 09:46:58.977394 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [req-25ec2032-bb57-4d28-96d2-05b9b86760c0 req-5e373f84-ad8a-4cc1-b563-cc86cf743176 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071621 Oct 28 09:46:58.980231 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 68/132] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Oct 28 09:46:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:46:59.204613 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.virt.hardware [None req-a99bab3d-11da-4f23-965a-6b774ea968d2 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Flavor limits 0:0:0 {{(pid=127032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 09:46:59.205028 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.virt.hardware [None req-a99bab3d-11da-4f23-965a-6b774ea968d2 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Image limits 0:0:0 {{(pid=127032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 09:46:59.205492 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.virt.hardware [None req-a99bab3d-11da-4f23-965a-6b774ea968d2 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Flavor pref 0:0:0 {{(pid=127032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 09:46:59.205887 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.virt.hardware [None req-a99bab3d-11da-4f23-965a-6b774ea968d2 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Image pref 0:0:0 {{(pid=127032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 09:46:59.206441 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.virt.hardware [None req-a99bab3d-11da-4f23-965a-6b774ea968d2 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 09:46:59.217082 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-a99bab3d-11da-4f23-965a-6b774ea968d2 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:59.217576 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-a99bab3d-11da-4f23-965a-6b774ea968d2 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:59.218054 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-a99bab3d-11da-4f23-965a-6b774ea968d2 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:59.218867 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-a99bab3d-11da-4f23-965a-6b774ea968d2 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:46:59.219363 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-a99bab3d-11da-4f23-965a-6b774ea968d2 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:46:59.220189 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-a99bab3d-11da-4f23-965a-6b774ea968d2 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:46:59.241392 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.quota [None req-a99bab3d-11da-4f23-965a-6b774ea968d2 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Getting quotas for project 234f69f21d7a456a9ab6a86c4ac2ede2. Resources: {'cores', 'ram', 'instances'} {{(pid=127032) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 09:46:59.246908 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.quota [None req-a99bab3d-11da-4f23-965a-6b774ea968d2 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Getting quotas for user cfe6eb38e8df492daaef5755ddea7773 and project 234f69f21d7a456a9ab6a86c4ac2ede2. Resources: {'cores', 'ram', 'instances'} {{(pid=127032) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 09:46:59.264291 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-a99bab3d-11da-4f23-965a-6b774ea968d2 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Going to run 1 instances... {{(pid=127032) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 09:46:59.266859 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-a99bab3d-11da-4f23-965a-6b774ea968d2 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: 9705038a-caef-4cf0-ae5f-b6ebcb2dbea6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e314146-a2ed-4f8b-afdd-4f7ed1184d20',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127032) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 09:46:59.317312 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-a99bab3d-11da-4f23-965a-6b774ea968d2 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.080322 Oct 28 09:46:59.317973 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 65/133] 10.222.0.52 () {60 vars in 1147 bytes} [Fri Oct 28 09:46:54 2022] POST /compute/v2.1/servers => generated 383 bytes in 5082 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 09:46:59.331846 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-9c14e7bb-0bbf-47d8-b305-1c0922b035ec tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:46:59.332566 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-9c14e7bb-0bbf-47d8-b305-1c0922b035ec tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: 9705038a-caef-4cf0-ae5f-b6ebcb2dbea6] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:46:59.423945 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-9c14e7bb-0bbf-47d8-b305-1c0922b035ec tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe6eb38e8df492daaef5755ddea7773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234f69f21d7a456a9ab6a86c4ac2ede2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:46:59.431878 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-9c14e7bb-0bbf-47d8-b305-1c0922b035ec tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] 10.222.0.52 "GET /compute/v2.1/servers/9705038a-caef-4cf0-ae5f-b6ebcb2dbea6" status: 200 len: 1221 microversion: 2.1 time: 0.105576 Oct 28 09:46:59.432654 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 69/134] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:46:59 2022] GET /compute/v2.1/servers/9705038a-caef-4cf0-ae5f-b6ebcb2dbea6 => generated 1221 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:47:00.457350 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-e23988f5-dfd0-4fb6-b649-07b97214be52 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:47:00.457860 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-e23988f5-dfd0-4fb6-b649-07b97214be52 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: 9705038a-caef-4cf0-ae5f-b6ebcb2dbea6] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:47:00.464216 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-e23988f5-dfd0-4fb6-b649-07b97214be52 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:00.465409 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-e23988f5-dfd0-4fb6-b649-07b97214be52 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:00.465409 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-e23988f5-dfd0-4fb6-b649-07b97214be52 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:00.465801 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-e23988f5-dfd0-4fb6-b649-07b97214be52 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:00.466249 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-e23988f5-dfd0-4fb6-b649-07b97214be52 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:00.466667 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-e23988f5-dfd0-4fb6-b649-07b97214be52 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:00.533270 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-e23988f5-dfd0-4fb6-b649-07b97214be52 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe6eb38e8df492daaef5755ddea7773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234f69f21d7a456a9ab6a86c4ac2ede2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:47:00.542253 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-e23988f5-dfd0-4fb6-b649-07b97214be52 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] 10.222.0.52 "GET /compute/v2.1/servers/9705038a-caef-4cf0-ae5f-b6ebcb2dbea6" status: 200 len: 1225 microversion: 2.1 time: 0.088854 Oct 28 09:47:00.542941 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 66/135] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:47:00 2022] GET /compute/v2.1/servers/9705038a-caef-4cf0-ae5f-b6ebcb2dbea6 => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:47:01.566617 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-6c08d52b-4522-49a4-93a7-b6f9a7541609 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:47:01.567352 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-6c08d52b-4522-49a4-93a7-b6f9a7541609 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: 9705038a-caef-4cf0-ae5f-b6ebcb2dbea6] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:47:01.574731 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-6c08d52b-4522-49a4-93a7-b6f9a7541609 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:01.575225 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-6c08d52b-4522-49a4-93a7-b6f9a7541609 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:01.575660 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-6c08d52b-4522-49a4-93a7-b6f9a7541609 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:01.576386 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-6c08d52b-4522-49a4-93a7-b6f9a7541609 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:01.576841 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-6c08d52b-4522-49a4-93a7-b6f9a7541609 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:01.577293 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-6c08d52b-4522-49a4-93a7-b6f9a7541609 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:01.638239 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-6c08d52b-4522-49a4-93a7-b6f9a7541609 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe6eb38e8df492daaef5755ddea7773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234f69f21d7a456a9ab6a86c4ac2ede2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:47:01.645979 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-6c08d52b-4522-49a4-93a7-b6f9a7541609 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] 10.222.0.52 "GET /compute/v2.1/servers/9705038a-caef-4cf0-ae5f-b6ebcb2dbea6" status: 200 len: 1225 microversion: 2.1 time: 0.083378 Oct 28 09:47:01.647452 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 70/136] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:47:01 2022] GET /compute/v2.1/servers/9705038a-caef-4cf0-ae5f-b6ebcb2dbea6 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:47:02.669749 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-afebd288-d103-4a55-b37f-d1c15dffac46 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:47:02.670593 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-afebd288-d103-4a55-b37f-d1c15dffac46 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: 9705038a-caef-4cf0-ae5f-b6ebcb2dbea6] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:47:02.672383 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG dbcounter [-] [127032] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=127032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:47:02.678873 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-afebd288-d103-4a55-b37f-d1c15dffac46 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:02.679008 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-afebd288-d103-4a55-b37f-d1c15dffac46 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:02.679535 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-afebd288-d103-4a55-b37f-d1c15dffac46 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:02.680206 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-afebd288-d103-4a55-b37f-d1c15dffac46 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:02.680652 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-afebd288-d103-4a55-b37f-d1c15dffac46 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:02.681152 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-afebd288-d103-4a55-b37f-d1c15dffac46 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:02.684566 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG dbcounter [-] [127032] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:47:02.757446 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-afebd288-d103-4a55-b37f-d1c15dffac46 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe6eb38e8df492daaef5755ddea7773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234f69f21d7a456a9ab6a86c4ac2ede2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:47:02.769941 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-afebd288-d103-4a55-b37f-d1c15dffac46 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] 10.222.0.52 "GET /compute/v2.1/servers/9705038a-caef-4cf0-ae5f-b6ebcb2dbea6" status: 200 len: 1225 microversion: 2.1 time: 0.103751 Oct 28 09:47:02.771763 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 67/137] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:47:02 2022] GET /compute/v2.1/servers/9705038a-caef-4cf0-ae5f-b6ebcb2dbea6 => generated 1225 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:47:03.798796 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-5eedf73d-866c-4f88-9adb-d906d4f49d9a tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:47:03.800700 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-5eedf73d-866c-4f88-9adb-d906d4f49d9a tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: 9705038a-caef-4cf0-ae5f-b6ebcb2dbea6] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:47:03.806743 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG dbcounter [-] [127033] Writing DB stats nova_api:SELECT=34 {{(pid=127033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:47:03.814699 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-5eedf73d-866c-4f88-9adb-d906d4f49d9a tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:03.815264 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-5eedf73d-866c-4f88-9adb-d906d4f49d9a tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:03.816021 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-5eedf73d-866c-4f88-9adb-d906d4f49d9a tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:03.816726 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-5eedf73d-866c-4f88-9adb-d906d4f49d9a tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:03.817147 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-5eedf73d-866c-4f88-9adb-d906d4f49d9a tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:03.817576 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-5eedf73d-866c-4f88-9adb-d906d4f49d9a tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:03.897081 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-5eedf73d-866c-4f88-9adb-d906d4f49d9a tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe6eb38e8df492daaef5755ddea7773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234f69f21d7a456a9ab6a86c4ac2ede2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:47:03.905219 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-5eedf73d-866c-4f88-9adb-d906d4f49d9a tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] 10.222.0.52 "GET /compute/v2.1/servers/9705038a-caef-4cf0-ae5f-b6ebcb2dbea6" status: 200 len: 1281 microversion: 2.1 time: 0.110407 Oct 28 09:47:03.909033 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 71/138] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:47:03 2022] GET /compute/v2.1/servers/9705038a-caef-4cf0-ae5f-b6ebcb2dbea6 => generated 1281 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:47:04.944867 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-1be4f402-62a8-42a4-80e8-2ae0909391e8 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:47:04.945952 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-1be4f402-62a8-42a4-80e8-2ae0909391e8 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: 9705038a-caef-4cf0-ae5f-b6ebcb2dbea6] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:47:04.964670 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-1be4f402-62a8-42a4-80e8-2ae0909391e8 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:04.965704 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-1be4f402-62a8-42a4-80e8-2ae0909391e8 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:04.967913 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-1be4f402-62a8-42a4-80e8-2ae0909391e8 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:04.969313 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-1be4f402-62a8-42a4-80e8-2ae0909391e8 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:04.970179 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-1be4f402-62a8-42a4-80e8-2ae0909391e8 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:04.971852 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-1be4f402-62a8-42a4-80e8-2ae0909391e8 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:05.249424 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-1be4f402-62a8-42a4-80e8-2ae0909391e8 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe6eb38e8df492daaef5755ddea7773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234f69f21d7a456a9ab6a86c4ac2ede2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:47:05.258535 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-1be4f402-62a8-42a4-80e8-2ae0909391e8 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] 10.222.0.52 "GET /compute/v2.1/servers/9705038a-caef-4cf0-ae5f-b6ebcb2dbea6" status: 200 len: 1321 microversion: 2.1 time: 0.329065 Oct 28 09:47:05.259380 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 68/139] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:47:04 2022] GET /compute/v2.1/servers/9705038a-caef-4cf0-ae5f-b6ebcb2dbea6 => generated 1321 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:47:05.602504 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [req-f40f4620-dd30-4605-90b6-d02cd6895622 req-95f893c0-b010-44e2-b841-36a29495063d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9705038a-caef-4cf0-ae5f-b6ebcb2dbea6", "tag": "13abc86d-9c0f-4501-ac09-79754e63f048"}]} {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:47:05.623510 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-f40f4620-dd30-4605-90b6-d02cd6895622 req-95f893c0-b010-44e2-b841-36a29495063d service nova] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:05.624492 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-f40f4620-dd30-4605-90b6-d02cd6895622 req-95f893c0-b010-44e2-b841-36a29495063d service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:05.625033 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-f40f4620-dd30-4605-90b6-d02cd6895622 req-95f893c0-b010-44e2-b841-36a29495063d service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:05.643919 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.compute.server_external_events [req-f40f4620-dd30-4605-90b6-d02cd6895622 req-95f893c0-b010-44e2-b841-36a29495063d service nova] Creating event network-changed:13abc86d-9c0f-4501-ac09-79754e63f048 for instance 9705038a-caef-4cf0-ae5f-b6ebcb2dbea6 on hv-cinder-zed-3 Oct 28 09:47:05.676643 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [req-f40f4620-dd30-4605-90b6-d02cd6895622 req-95f893c0-b010-44e2-b841-36a29495063d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082037 Oct 28 09:47:05.677673 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 72/140] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Oct 28 09:47:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:47:05.715917 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [req-60d9c4f7-e2a3-4796-a8fc-50d926f4cd93 req-0b4f0218-9717-4346-b1d6-e8431611d4e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1eaf7cc8-63d3-40c6-b5f5-e4e978ddfe17", "name": "network-vif-plugged", "status": "completed", "tag": "598d1cbf-c937-4e8e-b9ab-10c22cbd11e8"}]} {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:47:05.735669 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-60d9c4f7-e2a3-4796-a8fc-50d926f4cd93 req-0b4f0218-9717-4346-b1d6-e8431611d4e9 service nova] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:05.736761 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-60d9c4f7-e2a3-4796-a8fc-50d926f4cd93 req-0b4f0218-9717-4346-b1d6-e8431611d4e9 service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:05.738293 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-60d9c4f7-e2a3-4796-a8fc-50d926f4cd93 req-0b4f0218-9717-4346-b1d6-e8431611d4e9 service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:05.768227 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.compute.server_external_events [req-60d9c4f7-e2a3-4796-a8fc-50d926f4cd93 req-0b4f0218-9717-4346-b1d6-e8431611d4e9 service nova] Creating event network-vif-plugged:598d1cbf-c937-4e8e-b9ab-10c22cbd11e8 for instance 1eaf7cc8-63d3-40c6-b5f5-e4e978ddfe17 on hv-cinder-zed-3 Oct 28 09:47:05.777004 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [req-60d9c4f7-e2a3-4796-a8fc-50d926f4cd93 req-0b4f0218-9717-4346-b1d6-e8431611d4e9 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072814 Oct 28 09:47:05.778170 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 69/141] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Oct 28 09:47:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 09:47:06.305172 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-aaa03319-04c9-4976-b0b4-b83271e0e4df tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:47:06.306031 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-aaa03319-04c9-4976-b0b4-b83271e0e4df tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: 9705038a-caef-4cf0-ae5f-b6ebcb2dbea6] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:47:06.314710 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-aaa03319-04c9-4976-b0b4-b83271e0e4df tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:06.315422 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-aaa03319-04c9-4976-b0b4-b83271e0e4df tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:06.316154 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-aaa03319-04c9-4976-b0b4-b83271e0e4df tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:06.316955 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-aaa03319-04c9-4976-b0b4-b83271e0e4df tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:06.317637 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-aaa03319-04c9-4976-b0b4-b83271e0e4df tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:06.318067 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-aaa03319-04c9-4976-b0b4-b83271e0e4df tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:06.494982 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-aaa03319-04c9-4976-b0b4-b83271e0e4df tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe6eb38e8df492daaef5755ddea7773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234f69f21d7a456a9ab6a86c4ac2ede2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:47:06.506609 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-aaa03319-04c9-4976-b0b4-b83271e0e4df tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] 10.222.0.52 "GET /compute/v2.1/servers/9705038a-caef-4cf0-ae5f-b6ebcb2dbea6" status: 200 len: 1321 microversion: 2.1 time: 0.225636 Oct 28 09:47:06.507598 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 73/142] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:47:06 2022] GET /compute/v2.1/servers/9705038a-caef-4cf0-ae5f-b6ebcb2dbea6 => generated 1321 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:47:07.538814 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-e2a3238e-819e-497b-9fc5-9b4032cc796f tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:47:07.540317 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-e2a3238e-819e-497b-9fc5-9b4032cc796f tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: 9705038a-caef-4cf0-ae5f-b6ebcb2dbea6] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:47:07.556053 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-e2a3238e-819e-497b-9fc5-9b4032cc796f tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:07.557840 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-e2a3238e-819e-497b-9fc5-9b4032cc796f tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:07.558445 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-e2a3238e-819e-497b-9fc5-9b4032cc796f tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:07.559188 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-e2a3238e-819e-497b-9fc5-9b4032cc796f tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:07.568190 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-e2a3238e-819e-497b-9fc5-9b4032cc796f tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:07.570415 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-e2a3238e-819e-497b-9fc5-9b4032cc796f tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:07.990610 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-e2a3238e-819e-497b-9fc5-9b4032cc796f tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe6eb38e8df492daaef5755ddea7773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234f69f21d7a456a9ab6a86c4ac2ede2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:47:08.002397 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-e2a3238e-819e-497b-9fc5-9b4032cc796f tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] 10.222.0.52 "GET /compute/v2.1/servers/9705038a-caef-4cf0-ae5f-b6ebcb2dbea6" status: 200 len: 1321 microversion: 2.1 time: 0.467706 Oct 28 09:47:08.003313 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 70/143] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:47:07 2022] GET /compute/v2.1/servers/9705038a-caef-4cf0-ae5f-b6ebcb2dbea6 => generated 1321 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:47:09.042909 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-6f235a89-5c3c-4d1d-abf2-31b807cf41c2 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:47:09.043777 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-6f235a89-5c3c-4d1d-abf2-31b807cf41c2 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: 9705038a-caef-4cf0-ae5f-b6ebcb2dbea6] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:47:09.051676 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-6f235a89-5c3c-4d1d-abf2-31b807cf41c2 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:09.052221 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-6f235a89-5c3c-4d1d-abf2-31b807cf41c2 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:09.052761 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-6f235a89-5c3c-4d1d-abf2-31b807cf41c2 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:09.053434 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-6f235a89-5c3c-4d1d-abf2-31b807cf41c2 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:09.053894 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-6f235a89-5c3c-4d1d-abf2-31b807cf41c2 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:09.054381 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-6f235a89-5c3c-4d1d-abf2-31b807cf41c2 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:09.205014 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-6f235a89-5c3c-4d1d-abf2-31b807cf41c2 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe6eb38e8df492daaef5755ddea7773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234f69f21d7a456a9ab6a86c4ac2ede2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:47:09.214653 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-6f235a89-5c3c-4d1d-abf2-31b807cf41c2 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] 10.222.0.52 "GET /compute/v2.1/servers/9705038a-caef-4cf0-ae5f-b6ebcb2dbea6" status: 200 len: 1321 microversion: 2.1 time: 0.175517 Oct 28 09:47:09.215665 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 74/144] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:47:09 2022] GET /compute/v2.1/servers/9705038a-caef-4cf0-ae5f-b6ebcb2dbea6 => generated 1321 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:47:10.252410 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-df9e48ee-6b93-4633-86b9-0f66b3e37a95 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:47:10.253839 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-df9e48ee-6b93-4633-86b9-0f66b3e37a95 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: 9705038a-caef-4cf0-ae5f-b6ebcb2dbea6] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:47:10.256185 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG dbcounter [-] [127032] Writing DB stats nova_cell0:SELECT=4 {{(pid=127032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:47:10.256861 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG dbcounter [-] [127032] Writing DB stats nova_cell0:SELECT=12 {{(pid=127032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:47:10.262912 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-df9e48ee-6b93-4633-86b9-0f66b3e37a95 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:10.263478 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-df9e48ee-6b93-4633-86b9-0f66b3e37a95 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:10.263971 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-df9e48ee-6b93-4633-86b9-0f66b3e37a95 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:10.265267 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-df9e48ee-6b93-4633-86b9-0f66b3e37a95 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:10.266481 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-df9e48ee-6b93-4633-86b9-0f66b3e37a95 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:10.267226 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-df9e48ee-6b93-4633-86b9-0f66b3e37a95 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:10.457019 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-df9e48ee-6b93-4633-86b9-0f66b3e37a95 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe6eb38e8df492daaef5755ddea7773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234f69f21d7a456a9ab6a86c4ac2ede2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:47:10.468274 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-df9e48ee-6b93-4633-86b9-0f66b3e37a95 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] 10.222.0.52 "GET /compute/v2.1/servers/9705038a-caef-4cf0-ae5f-b6ebcb2dbea6" status: 200 len: 1321 microversion: 2.1 time: 0.221544 Oct 28 09:47:10.469229 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 71/145] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:47:10 2022] GET /compute/v2.1/servers/9705038a-caef-4cf0-ae5f-b6ebcb2dbea6 => generated 1321 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:47:11.493047 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-e18d23a5-be41-4dcf-9943-235896b52524 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:47:11.493659 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-e18d23a5-be41-4dcf-9943-235896b52524 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: 9705038a-caef-4cf0-ae5f-b6ebcb2dbea6] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:47:11.495648 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG dbcounter [-] [127033] Writing DB stats nova_cell0:SELECT=4 {{(pid=127033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:47:11.501511 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-e18d23a5-be41-4dcf-9943-235896b52524 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:11.501999 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-e18d23a5-be41-4dcf-9943-235896b52524 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:11.502432 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-e18d23a5-be41-4dcf-9943-235896b52524 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:11.503125 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-e18d23a5-be41-4dcf-9943-235896b52524 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:11.503580 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-e18d23a5-be41-4dcf-9943-235896b52524 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:11.504029 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-e18d23a5-be41-4dcf-9943-235896b52524 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:11.643635 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-e18d23a5-be41-4dcf-9943-235896b52524 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe6eb38e8df492daaef5755ddea7773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234f69f21d7a456a9ab6a86c4ac2ede2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:47:11.654486 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-e18d23a5-be41-4dcf-9943-235896b52524 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] 10.222.0.52 "GET /compute/v2.1/servers/9705038a-caef-4cf0-ae5f-b6ebcb2dbea6" status: 200 len: 1321 microversion: 2.1 time: 0.165195 Oct 28 09:47:11.655647 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 75/146] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:47:11 2022] GET /compute/v2.1/servers/9705038a-caef-4cf0-ae5f-b6ebcb2dbea6 => generated 1321 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:47:12.306041 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-7e693d2d-10a8-4257-a06a-d4ed3009e473 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-266761108", "imageRef": "6e314146-a2ed-4f8b-afdd-4f7ed1184d20", "flavorRef": "452", "networks": [{"uuid": "1cd861d2-007f-4e5c-8db8-b92530b04cbf"}]}} {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:47:12.367623 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.network.neutron [None req-7e693d2d-10a8-4257-a06a-d4ed3009e473 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] validate_networks() for [('1cd861d2-007f-4e5c-8db8-b92530b04cbf', None, None, None, None, None)] {{(pid=127032) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 09:47:12.679425 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-9d818423-d1b3-4a2b-bd9c-f4b51f2269ff tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:47:12.680065 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-9d818423-d1b3-4a2b-bd9c-f4b51f2269ff tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: 9705038a-caef-4cf0-ae5f-b6ebcb2dbea6] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:47:12.686177 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-9d818423-d1b3-4a2b-bd9c-f4b51f2269ff tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:12.686666 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-9d818423-d1b3-4a2b-bd9c-f4b51f2269ff tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:12.687100 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-9d818423-d1b3-4a2b-bd9c-f4b51f2269ff tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:12.687961 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-9d818423-d1b3-4a2b-bd9c-f4b51f2269ff tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:12.688423 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-9d818423-d1b3-4a2b-bd9c-f4b51f2269ff tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:12.688846 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-9d818423-d1b3-4a2b-bd9c-f4b51f2269ff tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:12.781993 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.virt.hardware [None req-7e693d2d-10a8-4257-a06a-d4ed3009e473 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Flavor limits 0:0:0 {{(pid=127032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 09:47:12.781993 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.virt.hardware [None req-7e693d2d-10a8-4257-a06a-d4ed3009e473 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Image limits 0:0:0 {{(pid=127032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 09:47:12.781993 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.virt.hardware [None req-7e693d2d-10a8-4257-a06a-d4ed3009e473 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Flavor pref 0:0:0 {{(pid=127032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 09:47:12.782832 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.virt.hardware [None req-7e693d2d-10a8-4257-a06a-d4ed3009e473 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Image pref 0:0:0 {{(pid=127032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 09:47:12.783510 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.virt.hardware [None req-7e693d2d-10a8-4257-a06a-d4ed3009e473 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 09:47:12.795186 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-7e693d2d-10a8-4257-a06a-d4ed3009e473 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:12.804304 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-7e693d2d-10a8-4257-a06a-d4ed3009e473 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:12.804930 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-7e693d2d-10a8-4257-a06a-d4ed3009e473 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:12.805762 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-7e693d2d-10a8-4257-a06a-d4ed3009e473 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:12.806240 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-7e693d2d-10a8-4257-a06a-d4ed3009e473 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:12.806884 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-7e693d2d-10a8-4257-a06a-d4ed3009e473 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:12.841293 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.quota [None req-7e693d2d-10a8-4257-a06a-d4ed3009e473 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Getting quotas for project 23f1d6189cfd4437a13a0908119c7ecb. Resources: {'cores', 'ram', 'instances'} {{(pid=127032) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 09:47:12.846063 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.quota [None req-7e693d2d-10a8-4257-a06a-d4ed3009e473 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Getting quotas for user 36846c3821c14284893e25dd143d11e2 and project 23f1d6189cfd4437a13a0908119c7ecb. Resources: {'cores', 'ram', 'instances'} {{(pid=127032) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 09:47:12.852214 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-9d818423-d1b3-4a2b-bd9c-f4b51f2269ff tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe6eb38e8df492daaef5755ddea7773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234f69f21d7a456a9ab6a86c4ac2ede2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:47:12.860015 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-7e693d2d-10a8-4257-a06a-d4ed3009e473 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Going to run 1 instances... {{(pid=127032) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 09:47:12.860247 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-9d818423-d1b3-4a2b-bd9c-f4b51f2269ff tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] 10.222.0.52 "GET /compute/v2.1/servers/9705038a-caef-4cf0-ae5f-b6ebcb2dbea6" status: 200 len: 1321 microversion: 2.1 time: 0.185998 Oct 28 09:47:12.860889 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 76/147] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:47:12 2022] GET /compute/v2.1/servers/9705038a-caef-4cf0-ae5f-b6ebcb2dbea6 => generated 1321 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:47:12.862592 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-7e693d2d-10a8-4257-a06a-d4ed3009e473 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] [instance: 86989378-da9a-4b30-98a7-1ce557ef51cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e314146-a2ed-4f8b-afdd-4f7ed1184d20',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127032) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 09:47:12.909809 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-7e693d2d-10a8-4257-a06a-d4ed3009e473 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.609083 Oct 28 09:47:12.910458 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 72/148] 10.222.0.52 () {60 vars in 1147 bytes} [Fri Oct 28 09:47:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 611 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 09:47:12.922019 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-d9e7219b-87f9-4ecd-bcc0-5235076b6e7e tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:47:12.922636 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-d9e7219b-87f9-4ecd-bcc0-5235076b6e7e tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] [instance: 86989378-da9a-4b30-98a7-1ce557ef51cb] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:47:12.982310 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-d9e7219b-87f9-4ecd-bcc0-5235076b6e7e tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36846c3821c14284893e25dd143d11e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1d6189cfd4437a13a0908119c7ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:47:12.989142 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-d9e7219b-87f9-4ecd-bcc0-5235076b6e7e tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] 10.222.0.52 "GET /compute/v2.1/servers/86989378-da9a-4b30-98a7-1ce557ef51cb" status: 200 len: 1218 microversion: 2.1 time: 0.070866 Oct 28 09:47:12.989718 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 77/149] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:47:12 2022] GET /compute/v2.1/servers/86989378-da9a-4b30-98a7-1ce557ef51cb => generated 1218 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:47:13.453113 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [req-1e2e5429-4443-4334-9537-f813e71166a3 req-bb62534e-f52e-48a6-b205-3c9d2bbaaf6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9705038a-caef-4cf0-ae5f-b6ebcb2dbea6", "name": "network-vif-plugged", "status": "completed", "tag": "13abc86d-9c0f-4501-ac09-79754e63f048"}]} {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:47:13.463554 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-1e2e5429-4443-4334-9537-f813e71166a3 req-bb62534e-f52e-48a6-b205-3c9d2bbaaf6e service nova] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:13.464278 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-1e2e5429-4443-4334-9537-f813e71166a3 req-bb62534e-f52e-48a6-b205-3c9d2bbaaf6e service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:13.464934 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-1e2e5429-4443-4334-9537-f813e71166a3 req-bb62534e-f52e-48a6-b205-3c9d2bbaaf6e service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:13.477369 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.compute.server_external_events [req-1e2e5429-4443-4334-9537-f813e71166a3 req-bb62534e-f52e-48a6-b205-3c9d2bbaaf6e service nova] Creating event network-vif-plugged:13abc86d-9c0f-4501-ac09-79754e63f048 for instance 9705038a-caef-4cf0-ae5f-b6ebcb2dbea6 on hv-cinder-zed-3 Oct 28 09:47:13.483446 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [req-1e2e5429-4443-4334-9537-f813e71166a3 req-bb62534e-f52e-48a6-b205-3c9d2bbaaf6e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033828 Oct 28 09:47:13.484378 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 73/150] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Oct 28 09:47:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:47:13.888165 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-72b6ef88-d3ef-41c2-b9d8-01da2a0e4c03 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:47:13.888165 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-72b6ef88-d3ef-41c2-b9d8-01da2a0e4c03 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: 9705038a-caef-4cf0-ae5f-b6ebcb2dbea6] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:47:13.893711 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-72b6ef88-d3ef-41c2-b9d8-01da2a0e4c03 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:13.894199 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-72b6ef88-d3ef-41c2-b9d8-01da2a0e4c03 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:13.894632 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-72b6ef88-d3ef-41c2-b9d8-01da2a0e4c03 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:13.895314 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-72b6ef88-d3ef-41c2-b9d8-01da2a0e4c03 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:13.895792 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-72b6ef88-d3ef-41c2-b9d8-01da2a0e4c03 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:13.896218 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-72b6ef88-d3ef-41c2-b9d8-01da2a0e4c03 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:14.018497 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-e431e574-2cf4-4e1f-8604-e49be2e78d51 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:47:14.019340 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-e431e574-2cf4-4e1f-8604-e49be2e78d51 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] [instance: 86989378-da9a-4b30-98a7-1ce557ef51cb] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:47:14.026640 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-e431e574-2cf4-4e1f-8604-e49be2e78d51 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:14.027149 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-e431e574-2cf4-4e1f-8604-e49be2e78d51 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:14.027582 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-e431e574-2cf4-4e1f-8604-e49be2e78d51 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:14.028307 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-e431e574-2cf4-4e1f-8604-e49be2e78d51 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:14.028765 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-e431e574-2cf4-4e1f-8604-e49be2e78d51 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:14.029177 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-e431e574-2cf4-4e1f-8604-e49be2e78d51 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:14.032161 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-72b6ef88-d3ef-41c2-b9d8-01da2a0e4c03 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe6eb38e8df492daaef5755ddea7773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234f69f21d7a456a9ab6a86c4ac2ede2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:47:14.042908 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-72b6ef88-d3ef-41c2-b9d8-01da2a0e4c03 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] 10.222.0.52 "GET /compute/v2.1/servers/9705038a-caef-4cf0-ae5f-b6ebcb2dbea6" status: 200 len: 1321 microversion: 2.1 time: 0.160937 Oct 28 09:47:14.043490 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 78/151] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:47:13 2022] GET /compute/v2.1/servers/9705038a-caef-4cf0-ae5f-b6ebcb2dbea6 => generated 1321 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:47:14.093407 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-e431e574-2cf4-4e1f-8604-e49be2e78d51 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36846c3821c14284893e25dd143d11e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1d6189cfd4437a13a0908119c7ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:47:14.102130 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-e431e574-2cf4-4e1f-8604-e49be2e78d51 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] 10.222.0.52 "GET /compute/v2.1/servers/86989378-da9a-4b30-98a7-1ce557ef51cb" status: 200 len: 1270 microversion: 2.1 time: 0.088439 Oct 28 09:47:14.102836 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 74/152] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:47:14 2022] GET /compute/v2.1/servers/86989378-da9a-4b30-98a7-1ce557ef51cb => generated 1270 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:47:15.066733 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-23a11b7a-1ca9-4b58-ac5b-a73009ec2fdd tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:47:15.067396 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-23a11b7a-1ca9-4b58-ac5b-a73009ec2fdd tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: 9705038a-caef-4cf0-ae5f-b6ebcb2dbea6] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:47:15.074699 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-23a11b7a-1ca9-4b58-ac5b-a73009ec2fdd tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:15.075185 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-23a11b7a-1ca9-4b58-ac5b-a73009ec2fdd tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:15.075618 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-23a11b7a-1ca9-4b58-ac5b-a73009ec2fdd tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:15.076367 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-23a11b7a-1ca9-4b58-ac5b-a73009ec2fdd tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:15.077144 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-23a11b7a-1ca9-4b58-ac5b-a73009ec2fdd tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:15.077566 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-23a11b7a-1ca9-4b58-ac5b-a73009ec2fdd tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:15.127634 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-6720732d-a9a1-4ed4-bceb-8863c056a800 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:47:15.128205 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-6720732d-a9a1-4ed4-bceb-8863c056a800 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] [instance: 86989378-da9a-4b30-98a7-1ce557ef51cb] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:47:15.134845 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-6720732d-a9a1-4ed4-bceb-8863c056a800 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:15.135327 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-6720732d-a9a1-4ed4-bceb-8863c056a800 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:15.135773 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-6720732d-a9a1-4ed4-bceb-8863c056a800 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:15.136487 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-6720732d-a9a1-4ed4-bceb-8863c056a800 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:15.136932 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-6720732d-a9a1-4ed4-bceb-8863c056a800 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:15.137601 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-6720732d-a9a1-4ed4-bceb-8863c056a800 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:15.217648 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-6720732d-a9a1-4ed4-bceb-8863c056a800 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36846c3821c14284893e25dd143d11e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1d6189cfd4437a13a0908119c7ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:47:15.226007 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-6720732d-a9a1-4ed4-bceb-8863c056a800 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] 10.222.0.52 "GET /compute/v2.1/servers/86989378-da9a-4b30-98a7-1ce557ef51cb" status: 200 len: 1270 microversion: 2.1 time: 0.102216 Oct 28 09:47:15.226198 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 75/153] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:47:15 2022] GET /compute/v2.1/servers/86989378-da9a-4b30-98a7-1ce557ef51cb => generated 1270 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:47:15.240606 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-23a11b7a-1ca9-4b58-ac5b-a73009ec2fdd tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe6eb38e8df492daaef5755ddea7773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234f69f21d7a456a9ab6a86c4ac2ede2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:47:15.248267 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-23a11b7a-1ca9-4b58-ac5b-a73009ec2fdd tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] 10.222.0.52 "GET /compute/v2.1/servers/9705038a-caef-4cf0-ae5f-b6ebcb2dbea6" status: 200 len: 1321 microversion: 2.1 time: 0.185577 Oct 28 09:47:15.248829 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 79/154] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:47:15 2022] GET /compute/v2.1/servers/9705038a-caef-4cf0-ae5f-b6ebcb2dbea6 => generated 1321 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:47:16.257881 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-64f8536b-6215-4938-95f1-80fd696215ae tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:47:16.259034 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-64f8536b-6215-4938-95f1-80fd696215ae tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] [instance: 86989378-da9a-4b30-98a7-1ce557ef51cb] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:47:16.273741 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-7de7fb4a-7e35-4ab9-a562-1c198dc28c59 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:47:16.274965 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-7de7fb4a-7e35-4ab9-a562-1c198dc28c59 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: 9705038a-caef-4cf0-ae5f-b6ebcb2dbea6] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:47:16.282885 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-7de7fb4a-7e35-4ab9-a562-1c198dc28c59 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:16.284693 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-64f8536b-6215-4938-95f1-80fd696215ae tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:16.285178 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-64f8536b-6215-4938-95f1-80fd696215ae tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:16.285867 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-7de7fb4a-7e35-4ab9-a562-1c198dc28c59 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:16.286457 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-64f8536b-6215-4938-95f1-80fd696215ae tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:16.287349 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-64f8536b-6215-4938-95f1-80fd696215ae tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:16.287967 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-7de7fb4a-7e35-4ab9-a562-1c198dc28c59 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:16.288828 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-7de7fb4a-7e35-4ab9-a562-1c198dc28c59 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:16.289569 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-64f8536b-6215-4938-95f1-80fd696215ae tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:16.290284 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-7de7fb4a-7e35-4ab9-a562-1c198dc28c59 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:16.290964 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-64f8536b-6215-4938-95f1-80fd696215ae tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:16.291543 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-7de7fb4a-7e35-4ab9-a562-1c198dc28c59 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:16.394120 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-64f8536b-6215-4938-95f1-80fd696215ae tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36846c3821c14284893e25dd143d11e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1d6189cfd4437a13a0908119c7ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:47:16.403066 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-64f8536b-6215-4938-95f1-80fd696215ae tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] 10.222.0.52 "GET /compute/v2.1/servers/86989378-da9a-4b30-98a7-1ce557ef51cb" status: 200 len: 1276 microversion: 2.1 time: 0.155135 Oct 28 09:47:16.403646 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 76/155] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:47:16 2022] GET /compute/v2.1/servers/86989378-da9a-4b30-98a7-1ce557ef51cb => generated 1276 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:47:16.507340 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-7de7fb4a-7e35-4ab9-a562-1c198dc28c59 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe6eb38e8df492daaef5755ddea7773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234f69f21d7a456a9ab6a86c4ac2ede2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:47:16.518329 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-7de7fb4a-7e35-4ab9-a562-1c198dc28c59 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] 10.222.0.52 "GET /compute/v2.1/servers/9705038a-caef-4cf0-ae5f-b6ebcb2dbea6" status: 200 len: 1515 microversion: 2.1 time: 0.249855 Oct 28 09:47:16.518941 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 80/156] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:47:16 2022] GET /compute/v2.1/servers/9705038a-caef-4cf0-ae5f-b6ebcb2dbea6 => generated 1515 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:47:16.548704 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-d620f2b3-c3a7-4743-80ac-9dc70efc8732 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:47:16.551029 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-d620f2b3-c3a7-4743-80ac-9dc70efc8732 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: 9705038a-caef-4cf0-ae5f-b6ebcb2dbea6] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:47:16.557609 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-d620f2b3-c3a7-4743-80ac-9dc70efc8732 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:16.558093 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-d620f2b3-c3a7-4743-80ac-9dc70efc8732 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:16.558706 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-d620f2b3-c3a7-4743-80ac-9dc70efc8732 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:16.559554 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-d620f2b3-c3a7-4743-80ac-9dc70efc8732 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:16.560077 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-d620f2b3-c3a7-4743-80ac-9dc70efc8732 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:16.560496 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-d620f2b3-c3a7-4743-80ac-9dc70efc8732 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:16.586883 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.objects.instance [None req-d620f2b3-c3a7-4743-80ac-9dc70efc8732 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lazy-loading 'flavor' on Instance uuid 9705038a-caef-4cf0-ae5f-b6ebcb2dbea6 {{(pid=127032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:47:16.720572 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-d620f2b3-c3a7-4743-80ac-9dc70efc8732 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] 10.222.0.52 "POST /compute/v2.1/servers/9705038a-caef-4cf0-ae5f-b6ebcb2dbea6/action" status: 200 len: 32 microversion: 2.1 time: 0.180987 Oct 28 09:47:16.721200 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 77/157] 10.222.0.52 () {60 vars in 1278 bytes} [Fri Oct 28 09:47:16 2022] POST /compute/v2.1/servers/9705038a-caef-4cf0-ae5f-b6ebcb2dbea6/action => generated 32 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 09:47:16.732121 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-a12c545a-506b-4fe0-a297-77dc3858135b tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:47:16.733153 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-a12c545a-506b-4fe0-a297-77dc3858135b tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: 9705038a-caef-4cf0-ae5f-b6ebcb2dbea6] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:47:16.739606 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-a12c545a-506b-4fe0-a297-77dc3858135b tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:16.740783 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-a12c545a-506b-4fe0-a297-77dc3858135b tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:16.741509 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-a12c545a-506b-4fe0-a297-77dc3858135b tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:16.742183 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-a12c545a-506b-4fe0-a297-77dc3858135b tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:16.742670 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-a12c545a-506b-4fe0-a297-77dc3858135b tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:16.743098 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-a12c545a-506b-4fe0-a297-77dc3858135b tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:16.905213 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-a12c545a-506b-4fe0-a297-77dc3858135b tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe6eb38e8df492daaef5755ddea7773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234f69f21d7a456a9ab6a86c4ac2ede2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:47:16.920655 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-a12c545a-506b-4fe0-a297-77dc3858135b tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] 10.222.0.52 "GET /compute/v2.1/servers/9705038a-caef-4cf0-ae5f-b6ebcb2dbea6" status: 200 len: 1521 microversion: 2.1 time: 0.193647 Oct 28 09:47:16.921998 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 81/158] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:47:16 2022] GET /compute/v2.1/servers/9705038a-caef-4cf0-ae5f-b6ebcb2dbea6 => generated 1521 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:47:17.451227 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-eccbf52e-a79c-4247-ad94-f371ac54987d tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:47:17.452402 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-eccbf52e-a79c-4247-ad94-f371ac54987d tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] [instance: 86989378-da9a-4b30-98a7-1ce557ef51cb] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:47:17.463878 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-eccbf52e-a79c-4247-ad94-f371ac54987d tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:17.464843 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-eccbf52e-a79c-4247-ad94-f371ac54987d tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:17.465489 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-eccbf52e-a79c-4247-ad94-f371ac54987d tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:17.466339 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-eccbf52e-a79c-4247-ad94-f371ac54987d tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:17.467037 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-eccbf52e-a79c-4247-ad94-f371ac54987d tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:17.467924 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-eccbf52e-a79c-4247-ad94-f371ac54987d tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:17.640979 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-eccbf52e-a79c-4247-ad94-f371ac54987d tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36846c3821c14284893e25dd143d11e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1d6189cfd4437a13a0908119c7ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:47:17.655870 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-eccbf52e-a79c-4247-ad94-f371ac54987d tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] 10.222.0.52 "GET /compute/v2.1/servers/86989378-da9a-4b30-98a7-1ce557ef51cb" status: 200 len: 1318 microversion: 2.1 time: 0.224537 Oct 28 09:47:17.657058 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 78/159] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:47:17 2022] GET /compute/v2.1/servers/86989378-da9a-4b30-98a7-1ce557ef51cb => generated 1318 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:47:17.949821 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-9afd7add-23a3-4386-b7ec-d04efbbb9311 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:47:17.950435 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-9afd7add-23a3-4386-b7ec-d04efbbb9311 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: 9705038a-caef-4cf0-ae5f-b6ebcb2dbea6] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:47:17.956995 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-9afd7add-23a3-4386-b7ec-d04efbbb9311 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:17.957725 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-9afd7add-23a3-4386-b7ec-d04efbbb9311 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:17.958165 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-9afd7add-23a3-4386-b7ec-d04efbbb9311 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:17.958910 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-9afd7add-23a3-4386-b7ec-d04efbbb9311 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:17.959365 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-9afd7add-23a3-4386-b7ec-d04efbbb9311 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:17.960121 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-9afd7add-23a3-4386-b7ec-d04efbbb9311 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:18.187328 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-9afd7add-23a3-4386-b7ec-d04efbbb9311 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe6eb38e8df492daaef5755ddea7773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234f69f21d7a456a9ab6a86c4ac2ede2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:47:18.198537 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-9afd7add-23a3-4386-b7ec-d04efbbb9311 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] 10.222.0.52 "GET /compute/v2.1/servers/9705038a-caef-4cf0-ae5f-b6ebcb2dbea6" status: 200 len: 1521 microversion: 2.1 time: 0.252662 Oct 28 09:47:18.199277 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 82/160] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:47:17 2022] GET /compute/v2.1/servers/9705038a-caef-4cf0-ae5f-b6ebcb2dbea6 => generated 1521 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:47:18.467766 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [req-e19abb72-3780-445d-9965-2823d3314003 req-de3091eb-78d3-414b-ac11-576a644318d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86989378-da9a-4b30-98a7-1ce557ef51cb", "tag": "a633e606-b877-4581-904e-1301b95df872"}]} {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:47:18.478030 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-e19abb72-3780-445d-9965-2823d3314003 req-de3091eb-78d3-414b-ac11-576a644318d5 service nova] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:18.478516 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-e19abb72-3780-445d-9965-2823d3314003 req-de3091eb-78d3-414b-ac11-576a644318d5 service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:18.478935 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-e19abb72-3780-445d-9965-2823d3314003 req-de3091eb-78d3-414b-ac11-576a644318d5 service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:18.491267 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.compute.server_external_events [req-e19abb72-3780-445d-9965-2823d3314003 req-de3091eb-78d3-414b-ac11-576a644318d5 service nova] Creating event network-changed:a633e606-b877-4581-904e-1301b95df872 for instance 86989378-da9a-4b30-98a7-1ce557ef51cb on hv-cinder-zed-3 Oct 28 09:47:18.497358 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [req-e19abb72-3780-445d-9965-2823d3314003 req-de3091eb-78d3-414b-ac11-576a644318d5 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032979 Oct 28 09:47:18.511769 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 79/161] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Oct 28 09:47:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:47:18.693902 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-7347de23-8fc1-47d5-afea-1030707d1d40 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:47:18.694509 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-7347de23-8fc1-47d5-afea-1030707d1d40 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] [instance: 86989378-da9a-4b30-98a7-1ce557ef51cb] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:47:18.700370 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-7347de23-8fc1-47d5-afea-1030707d1d40 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:18.700858 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-7347de23-8fc1-47d5-afea-1030707d1d40 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:18.701289 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-7347de23-8fc1-47d5-afea-1030707d1d40 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:18.701973 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-7347de23-8fc1-47d5-afea-1030707d1d40 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:18.702459 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-7347de23-8fc1-47d5-afea-1030707d1d40 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:18.702875 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-7347de23-8fc1-47d5-afea-1030707d1d40 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:18.835802 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-7347de23-8fc1-47d5-afea-1030707d1d40 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36846c3821c14284893e25dd143d11e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1d6189cfd4437a13a0908119c7ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:47:18.844660 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-7347de23-8fc1-47d5-afea-1030707d1d40 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] 10.222.0.52 "GET /compute/v2.1/servers/86989378-da9a-4b30-98a7-1ce557ef51cb" status: 200 len: 1318 microversion: 2.1 time: 0.154589 Oct 28 09:47:18.846072 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 83/162] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:47:18 2022] GET /compute/v2.1/servers/86989378-da9a-4b30-98a7-1ce557ef51cb => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:47:19.228728 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-9d3e3f51-4a04-4292-b4aa-4485a7306edf tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:47:19.229693 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-9d3e3f51-4a04-4292-b4aa-4485a7306edf tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: 9705038a-caef-4cf0-ae5f-b6ebcb2dbea6] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:47:19.236251 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-9d3e3f51-4a04-4292-b4aa-4485a7306edf tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:19.236744 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-9d3e3f51-4a04-4292-b4aa-4485a7306edf tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:19.237183 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-9d3e3f51-4a04-4292-b4aa-4485a7306edf tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:19.238159 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-9d3e3f51-4a04-4292-b4aa-4485a7306edf tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:19.238536 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-9d3e3f51-4a04-4292-b4aa-4485a7306edf tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:19.238998 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-9d3e3f51-4a04-4292-b4aa-4485a7306edf tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:19.380358 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-9d3e3f51-4a04-4292-b4aa-4485a7306edf tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe6eb38e8df492daaef5755ddea7773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234f69f21d7a456a9ab6a86c4ac2ede2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:47:19.390313 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-9d3e3f51-4a04-4292-b4aa-4485a7306edf tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] 10.222.0.52 "GET /compute/v2.1/servers/9705038a-caef-4cf0-ae5f-b6ebcb2dbea6" status: 200 len: 1521 microversion: 2.1 time: 0.166351 Oct 28 09:47:19.390895 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 80/163] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:47:19 2022] GET /compute/v2.1/servers/9705038a-caef-4cf0-ae5f-b6ebcb2dbea6 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:47:19.872499 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-ee17a0a6-621d-4fc7-8ed0-06ec1cbc2dd6 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:47:19.874002 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-ee17a0a6-621d-4fc7-8ed0-06ec1cbc2dd6 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] [instance: 86989378-da9a-4b30-98a7-1ce557ef51cb] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:47:19.882484 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-ee17a0a6-621d-4fc7-8ed0-06ec1cbc2dd6 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:19.883066 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-ee17a0a6-621d-4fc7-8ed0-06ec1cbc2dd6 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:19.883513 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-ee17a0a6-621d-4fc7-8ed0-06ec1cbc2dd6 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:19.884245 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-ee17a0a6-621d-4fc7-8ed0-06ec1cbc2dd6 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:19.886806 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-ee17a0a6-621d-4fc7-8ed0-06ec1cbc2dd6 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:19.887472 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-ee17a0a6-621d-4fc7-8ed0-06ec1cbc2dd6 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:20.034476 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-ee17a0a6-621d-4fc7-8ed0-06ec1cbc2dd6 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36846c3821c14284893e25dd143d11e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1d6189cfd4437a13a0908119c7ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:47:20.042477 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-ee17a0a6-621d-4fc7-8ed0-06ec1cbc2dd6 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] 10.222.0.52 "GET /compute/v2.1/servers/86989378-da9a-4b30-98a7-1ce557ef51cb" status: 200 len: 1318 microversion: 2.1 time: 0.175435 Oct 28 09:47:20.043249 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 84/164] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:47:19 2022] GET /compute/v2.1/servers/86989378-da9a-4b30-98a7-1ce557ef51cb => generated 1318 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:47:20.415082 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-638a407c-153e-4865-bc03-dc06711c9c7c tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:47:20.415681 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-638a407c-153e-4865-bc03-dc06711c9c7c tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: 9705038a-caef-4cf0-ae5f-b6ebcb2dbea6] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:47:20.423869 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-638a407c-153e-4865-bc03-dc06711c9c7c tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:20.424366 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-638a407c-153e-4865-bc03-dc06711c9c7c tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:20.424798 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-638a407c-153e-4865-bc03-dc06711c9c7c tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:20.425515 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-638a407c-153e-4865-bc03-dc06711c9c7c tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:20.425963 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-638a407c-153e-4865-bc03-dc06711c9c7c tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:20.426390 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-638a407c-153e-4865-bc03-dc06711c9c7c tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:20.585516 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-638a407c-153e-4865-bc03-dc06711c9c7c tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe6eb38e8df492daaef5755ddea7773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234f69f21d7a456a9ab6a86c4ac2ede2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:47:20.594699 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-638a407c-153e-4865-bc03-dc06711c9c7c tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] 10.222.0.52 "GET /compute/v2.1/servers/9705038a-caef-4cf0-ae5f-b6ebcb2dbea6" status: 200 len: 1521 microversion: 2.1 time: 0.183816 Oct 28 09:47:20.595815 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 81/165] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:47:20 2022] GET /compute/v2.1/servers/9705038a-caef-4cf0-ae5f-b6ebcb2dbea6 => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:47:21.065416 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-a38de9c3-10e3-4787-bf1d-2ff0611da7b4 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:47:21.066032 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-a38de9c3-10e3-4787-bf1d-2ff0611da7b4 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] [instance: 86989378-da9a-4b30-98a7-1ce557ef51cb] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:47:21.073287 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-a38de9c3-10e3-4787-bf1d-2ff0611da7b4 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:21.073777 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-a38de9c3-10e3-4787-bf1d-2ff0611da7b4 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:21.074237 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-a38de9c3-10e3-4787-bf1d-2ff0611da7b4 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:21.074987 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-a38de9c3-10e3-4787-bf1d-2ff0611da7b4 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:21.075440 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-a38de9c3-10e3-4787-bf1d-2ff0611da7b4 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:21.075891 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-a38de9c3-10e3-4787-bf1d-2ff0611da7b4 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:21.242749 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-a38de9c3-10e3-4787-bf1d-2ff0611da7b4 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36846c3821c14284893e25dd143d11e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1d6189cfd4437a13a0908119c7ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:47:21.251983 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-a38de9c3-10e3-4787-bf1d-2ff0611da7b4 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] 10.222.0.52 "GET /compute/v2.1/servers/86989378-da9a-4b30-98a7-1ce557ef51cb" status: 200 len: 1318 microversion: 2.1 time: 0.189753 Oct 28 09:47:21.253370 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 85/166] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:47:21 2022] GET /compute/v2.1/servers/86989378-da9a-4b30-98a7-1ce557ef51cb => generated 1318 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:47:21.623833 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-4e6e78b4-52ad-4b18-a51c-1a4793dbed2c tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:47:21.624453 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-4e6e78b4-52ad-4b18-a51c-1a4793dbed2c tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: 9705038a-caef-4cf0-ae5f-b6ebcb2dbea6] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:47:21.630479 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-4e6e78b4-52ad-4b18-a51c-1a4793dbed2c tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:21.631474 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-4e6e78b4-52ad-4b18-a51c-1a4793dbed2c tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:21.631943 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-4e6e78b4-52ad-4b18-a51c-1a4793dbed2c tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:21.632636 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-4e6e78b4-52ad-4b18-a51c-1a4793dbed2c tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:21.633085 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-4e6e78b4-52ad-4b18-a51c-1a4793dbed2c tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:21.633501 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-4e6e78b4-52ad-4b18-a51c-1a4793dbed2c tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:21.774120 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-4e6e78b4-52ad-4b18-a51c-1a4793dbed2c tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe6eb38e8df492daaef5755ddea7773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234f69f21d7a456a9ab6a86c4ac2ede2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:47:21.781877 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-4e6e78b4-52ad-4b18-a51c-1a4793dbed2c tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] 10.222.0.52 "GET /compute/v2.1/servers/9705038a-caef-4cf0-ae5f-b6ebcb2dbea6" status: 200 len: 1521 microversion: 2.1 time: 0.162163 Oct 28 09:47:21.782456 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 82/167] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:47:21 2022] GET /compute/v2.1/servers/9705038a-caef-4cf0-ae5f-b6ebcb2dbea6 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:47:22.282458 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-919f87ce-bfce-42e8-bed1-0b42fb719e47 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:47:22.283052 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-919f87ce-bfce-42e8-bed1-0b42fb719e47 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] [instance: 86989378-da9a-4b30-98a7-1ce557ef51cb] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:47:22.290337 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-919f87ce-bfce-42e8-bed1-0b42fb719e47 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:22.292338 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-919f87ce-bfce-42e8-bed1-0b42fb719e47 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:22.292929 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-919f87ce-bfce-42e8-bed1-0b42fb719e47 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:22.294425 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-919f87ce-bfce-42e8-bed1-0b42fb719e47 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:22.294618 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-919f87ce-bfce-42e8-bed1-0b42fb719e47 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:22.295137 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-919f87ce-bfce-42e8-bed1-0b42fb719e47 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:22.476642 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-919f87ce-bfce-42e8-bed1-0b42fb719e47 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36846c3821c14284893e25dd143d11e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1d6189cfd4437a13a0908119c7ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:47:22.487686 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-919f87ce-bfce-42e8-bed1-0b42fb719e47 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] 10.222.0.52 "GET /compute/v2.1/servers/86989378-da9a-4b30-98a7-1ce557ef51cb" status: 200 len: 1318 microversion: 2.1 time: 0.208770 Oct 28 09:47:22.488614 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 86/168] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:47:22 2022] GET /compute/v2.1/servers/86989378-da9a-4b30-98a7-1ce557ef51cb => generated 1318 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:47:22.804645 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-e0afd7b3-eb5c-435e-92d8-dbfa6a8246ea tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:47:22.805257 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-e0afd7b3-eb5c-435e-92d8-dbfa6a8246ea tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: 9705038a-caef-4cf0-ae5f-b6ebcb2dbea6] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:47:22.811801 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-e0afd7b3-eb5c-435e-92d8-dbfa6a8246ea tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:22.812301 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-e0afd7b3-eb5c-435e-92d8-dbfa6a8246ea tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:22.812736 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-e0afd7b3-eb5c-435e-92d8-dbfa6a8246ea tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:22.813642 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-e0afd7b3-eb5c-435e-92d8-dbfa6a8246ea tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:22.814101 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-e0afd7b3-eb5c-435e-92d8-dbfa6a8246ea tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:22.814525 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-e0afd7b3-eb5c-435e-92d8-dbfa6a8246ea tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:22.815561 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG dbcounter [-] [127032] Writing DB stats nova_cell0:SELECT=2 {{(pid=127032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:47:22.858600 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG dbcounter [-] [127032] Writing DB stats nova_cell0:SELECT=6 {{(pid=127032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:47:22.988869 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-e0afd7b3-eb5c-435e-92d8-dbfa6a8246ea tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe6eb38e8df492daaef5755ddea7773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234f69f21d7a456a9ab6a86c4ac2ede2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:47:22.998745 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-e0afd7b3-eb5c-435e-92d8-dbfa6a8246ea tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] 10.222.0.52 "GET /compute/v2.1/servers/9705038a-caef-4cf0-ae5f-b6ebcb2dbea6" status: 200 len: 1521 microversion: 2.1 time: 0.198135 Oct 28 09:47:22.999689 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 83/169] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:47:22 2022] GET /compute/v2.1/servers/9705038a-caef-4cf0-ae5f-b6ebcb2dbea6 => generated 1521 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:47:23.513298 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-38f7fd00-8ce8-4893-926e-da84a8b60fff tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:47:23.514364 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-38f7fd00-8ce8-4893-926e-da84a8b60fff tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] [instance: 86989378-da9a-4b30-98a7-1ce557ef51cb] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:47:23.520121 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG dbcounter [-] [127033] Writing DB stats nova_cell0:SELECT=2 {{(pid=127033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:47:23.525338 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-38f7fd00-8ce8-4893-926e-da84a8b60fff tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:23.525933 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-38f7fd00-8ce8-4893-926e-da84a8b60fff tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:23.526372 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-38f7fd00-8ce8-4893-926e-da84a8b60fff tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:23.527058 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-38f7fd00-8ce8-4893-926e-da84a8b60fff tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:23.527538 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-38f7fd00-8ce8-4893-926e-da84a8b60fff tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:23.527986 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-38f7fd00-8ce8-4893-926e-da84a8b60fff tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:23.687382 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-38f7fd00-8ce8-4893-926e-da84a8b60fff tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36846c3821c14284893e25dd143d11e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1d6189cfd4437a13a0908119c7ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:47:23.691652 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG dbcounter [-] [127033] Writing DB stats nova_cell1:SELECT=100 {{(pid=127033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:47:23.700637 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-38f7fd00-8ce8-4893-926e-da84a8b60fff tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] 10.222.0.52 "GET /compute/v2.1/servers/86989378-da9a-4b30-98a7-1ce557ef51cb" status: 200 len: 1318 microversion: 2.1 time: 0.191303 Oct 28 09:47:23.701235 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 87/170] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:47:23 2022] GET /compute/v2.1/servers/86989378-da9a-4b30-98a7-1ce557ef51cb => generated 1318 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:47:24.038959 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-35a59724-455d-4ab5-8561-b8d6c03a4f1f tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:47:24.039682 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-35a59724-455d-4ab5-8561-b8d6c03a4f1f tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: 9705038a-caef-4cf0-ae5f-b6ebcb2dbea6] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:47:24.048239 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-35a59724-455d-4ab5-8561-b8d6c03a4f1f tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:24.048891 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-35a59724-455d-4ab5-8561-b8d6c03a4f1f tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:24.049623 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-35a59724-455d-4ab5-8561-b8d6c03a4f1f tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:24.050445 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-35a59724-455d-4ab5-8561-b8d6c03a4f1f tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:24.051032 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-35a59724-455d-4ab5-8561-b8d6c03a4f1f tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:24.051553 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-35a59724-455d-4ab5-8561-b8d6c03a4f1f tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:24.068044 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG dbcounter [-] [127032] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:47:24.203552 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-35a59724-455d-4ab5-8561-b8d6c03a4f1f tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe6eb38e8df492daaef5755ddea7773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234f69f21d7a456a9ab6a86c4ac2ede2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:47:24.212178 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-35a59724-455d-4ab5-8561-b8d6c03a4f1f tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] 10.222.0.52 "GET /compute/v2.1/servers/9705038a-caef-4cf0-ae5f-b6ebcb2dbea6" status: 200 len: 1521 microversion: 2.1 time: 0.177639 Oct 28 09:47:24.212794 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 84/171] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:47:24 2022] GET /compute/v2.1/servers/9705038a-caef-4cf0-ae5f-b6ebcb2dbea6 => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:47:24.726274 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-b94c42c0-cedf-4f97-a29e-fd7386f537bf tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:47:24.726812 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-b94c42c0-cedf-4f97-a29e-fd7386f537bf tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] [instance: 86989378-da9a-4b30-98a7-1ce557ef51cb] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:47:24.733592 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-b94c42c0-cedf-4f97-a29e-fd7386f537bf tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:24.734082 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-b94c42c0-cedf-4f97-a29e-fd7386f537bf tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:24.734520 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-b94c42c0-cedf-4f97-a29e-fd7386f537bf tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:24.735222 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-b94c42c0-cedf-4f97-a29e-fd7386f537bf tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:24.735678 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-b94c42c0-cedf-4f97-a29e-fd7386f537bf tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:24.736130 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-b94c42c0-cedf-4f97-a29e-fd7386f537bf tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:24.896821 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-b94c42c0-cedf-4f97-a29e-fd7386f537bf tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36846c3821c14284893e25dd143d11e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1d6189cfd4437a13a0908119c7ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:47:24.906407 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-b94c42c0-cedf-4f97-a29e-fd7386f537bf tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] 10.222.0.52 "GET /compute/v2.1/servers/86989378-da9a-4b30-98a7-1ce557ef51cb" status: 200 len: 1318 microversion: 2.1 time: 0.184586 Oct 28 09:47:24.907513 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 88/172] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:47:24 2022] GET /compute/v2.1/servers/86989378-da9a-4b30-98a7-1ce557ef51cb => generated 1318 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:47:25.236681 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-d48013b1-d428-4825-855a-65d997734148 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:47:25.237215 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-d48013b1-d428-4825-855a-65d997734148 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: 9705038a-caef-4cf0-ae5f-b6ebcb2dbea6] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:47:25.243887 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-d48013b1-d428-4825-855a-65d997734148 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:25.244368 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-d48013b1-d428-4825-855a-65d997734148 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:25.244801 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-d48013b1-d428-4825-855a-65d997734148 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:25.245491 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-d48013b1-d428-4825-855a-65d997734148 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:25.246017 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-d48013b1-d428-4825-855a-65d997734148 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:25.246444 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-d48013b1-d428-4825-855a-65d997734148 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:25.384705 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-d48013b1-d428-4825-855a-65d997734148 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe6eb38e8df492daaef5755ddea7773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234f69f21d7a456a9ab6a86c4ac2ede2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:47:25.392417 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-d48013b1-d428-4825-855a-65d997734148 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] 10.222.0.52 "GET /compute/v2.1/servers/9705038a-caef-4cf0-ae5f-b6ebcb2dbea6" status: 200 len: 1521 microversion: 2.1 time: 0.159660 Oct 28 09:47:25.392984 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 85/173] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:47:25 2022] GET /compute/v2.1/servers/9705038a-caef-4cf0-ae5f-b6ebcb2dbea6 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:47:25.931872 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-d93ade43-3980-4fbb-bda7-b6083b7507dc tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:47:25.932718 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-d93ade43-3980-4fbb-bda7-b6083b7507dc tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] [instance: 86989378-da9a-4b30-98a7-1ce557ef51cb] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:47:25.939279 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-d93ade43-3980-4fbb-bda7-b6083b7507dc tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:25.939758 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-d93ade43-3980-4fbb-bda7-b6083b7507dc tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:25.940205 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-d93ade43-3980-4fbb-bda7-b6083b7507dc tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:25.940906 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-d93ade43-3980-4fbb-bda7-b6083b7507dc tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:25.941361 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-d93ade43-3980-4fbb-bda7-b6083b7507dc tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:25.941780 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-d93ade43-3980-4fbb-bda7-b6083b7507dc tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:26.097542 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-d93ade43-3980-4fbb-bda7-b6083b7507dc tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36846c3821c14284893e25dd143d11e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1d6189cfd4437a13a0908119c7ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:47:26.106683 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-d93ade43-3980-4fbb-bda7-b6083b7507dc tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] 10.222.0.52 "GET /compute/v2.1/servers/86989378-da9a-4b30-98a7-1ce557ef51cb" status: 200 len: 1318 microversion: 2.1 time: 0.178720 Oct 28 09:47:26.107358 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 89/174] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:47:25 2022] GET /compute/v2.1/servers/86989378-da9a-4b30-98a7-1ce557ef51cb => generated 1318 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:47:26.415088 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-c161beba-e47b-469e-9866-5e5475cfde85 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:47:26.415813 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-c161beba-e47b-469e-9866-5e5475cfde85 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: 9705038a-caef-4cf0-ae5f-b6ebcb2dbea6] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:47:26.422795 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-c161beba-e47b-469e-9866-5e5475cfde85 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:26.423487 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-c161beba-e47b-469e-9866-5e5475cfde85 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:26.423966 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-c161beba-e47b-469e-9866-5e5475cfde85 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:26.424695 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-c161beba-e47b-469e-9866-5e5475cfde85 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:26.425177 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-c161beba-e47b-469e-9866-5e5475cfde85 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:26.425598 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-c161beba-e47b-469e-9866-5e5475cfde85 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:26.573651 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-c161beba-e47b-469e-9866-5e5475cfde85 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe6eb38e8df492daaef5755ddea7773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234f69f21d7a456a9ab6a86c4ac2ede2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:47:26.581513 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-c161beba-e47b-469e-9866-5e5475cfde85 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] 10.222.0.52 "GET /compute/v2.1/servers/9705038a-caef-4cf0-ae5f-b6ebcb2dbea6" status: 200 len: 1521 microversion: 2.1 time: 0.170392 Oct 28 09:47:26.582117 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 86/175] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:47:26 2022] GET /compute/v2.1/servers/9705038a-caef-4cf0-ae5f-b6ebcb2dbea6 => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:47:27.133006 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-397bd74e-3e56-46da-af6b-45d104c2e42c tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:47:27.133624 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-397bd74e-3e56-46da-af6b-45d104c2e42c tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] [instance: 86989378-da9a-4b30-98a7-1ce557ef51cb] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:47:27.151115 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-397bd74e-3e56-46da-af6b-45d104c2e42c tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:27.151115 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-397bd74e-3e56-46da-af6b-45d104c2e42c tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:27.151115 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-397bd74e-3e56-46da-af6b-45d104c2e42c tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:27.151115 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-397bd74e-3e56-46da-af6b-45d104c2e42c tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:27.151431 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-397bd74e-3e56-46da-af6b-45d104c2e42c tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:27.151431 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-397bd74e-3e56-46da-af6b-45d104c2e42c tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:27.282129 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-397bd74e-3e56-46da-af6b-45d104c2e42c tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36846c3821c14284893e25dd143d11e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1d6189cfd4437a13a0908119c7ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:47:27.290322 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-397bd74e-3e56-46da-af6b-45d104c2e42c tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] 10.222.0.52 "GET /compute/v2.1/servers/86989378-da9a-4b30-98a7-1ce557ef51cb" status: 200 len: 1318 microversion: 2.1 time: 0.161611 Oct 28 09:47:27.290885 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 90/176] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:47:27 2022] GET /compute/v2.1/servers/86989378-da9a-4b30-98a7-1ce557ef51cb => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:47:27.604217 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-61069589-087b-49ca-86fa-c9c912922ba7 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:47:27.605086 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-61069589-087b-49ca-86fa-c9c912922ba7 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: 9705038a-caef-4cf0-ae5f-b6ebcb2dbea6] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:47:27.611034 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-61069589-087b-49ca-86fa-c9c912922ba7 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:27.611510 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-61069589-087b-49ca-86fa-c9c912922ba7 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:27.611980 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-61069589-087b-49ca-86fa-c9c912922ba7 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:27.612663 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-61069589-087b-49ca-86fa-c9c912922ba7 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:27.613115 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-61069589-087b-49ca-86fa-c9c912922ba7 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:27.613535 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-61069589-087b-49ca-86fa-c9c912922ba7 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:27.749447 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-61069589-087b-49ca-86fa-c9c912922ba7 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe6eb38e8df492daaef5755ddea7773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234f69f21d7a456a9ab6a86c4ac2ede2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:47:27.758390 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-61069589-087b-49ca-86fa-c9c912922ba7 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] 10.222.0.52 "GET /compute/v2.1/servers/9705038a-caef-4cf0-ae5f-b6ebcb2dbea6" status: 200 len: 1521 microversion: 2.1 time: 0.158216 Oct 28 09:47:27.758970 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 87/177] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:47:27 2022] GET /compute/v2.1/servers/9705038a-caef-4cf0-ae5f-b6ebcb2dbea6 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:47:28.313610 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-10a108f4-0846-44e2-ba5d-a3e241a7d698 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:47:28.314135 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-10a108f4-0846-44e2-ba5d-a3e241a7d698 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] [instance: 86989378-da9a-4b30-98a7-1ce557ef51cb] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:47:28.320720 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-10a108f4-0846-44e2-ba5d-a3e241a7d698 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:28.321281 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-10a108f4-0846-44e2-ba5d-a3e241a7d698 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:28.321724 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-10a108f4-0846-44e2-ba5d-a3e241a7d698 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:28.322422 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-10a108f4-0846-44e2-ba5d-a3e241a7d698 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:28.322882 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-10a108f4-0846-44e2-ba5d-a3e241a7d698 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:28.323304 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-10a108f4-0846-44e2-ba5d-a3e241a7d698 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:28.461851 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-10a108f4-0846-44e2-ba5d-a3e241a7d698 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36846c3821c14284893e25dd143d11e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1d6189cfd4437a13a0908119c7ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:47:28.469348 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-10a108f4-0846-44e2-ba5d-a3e241a7d698 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] 10.222.0.52 "GET /compute/v2.1/servers/86989378-da9a-4b30-98a7-1ce557ef51cb" status: 200 len: 1318 microversion: 2.1 time: 0.159935 Oct 28 09:47:28.469904 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 91/178] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:47:28 2022] GET /compute/v2.1/servers/86989378-da9a-4b30-98a7-1ce557ef51cb => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:47:28.781208 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-1769711d-c237-44eb-a6ee-af19aa51b2e2 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:47:28.781921 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-1769711d-c237-44eb-a6ee-af19aa51b2e2 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: 9705038a-caef-4cf0-ae5f-b6ebcb2dbea6] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:47:28.788609 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-1769711d-c237-44eb-a6ee-af19aa51b2e2 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:28.789171 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-1769711d-c237-44eb-a6ee-af19aa51b2e2 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:28.789668 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-1769711d-c237-44eb-a6ee-af19aa51b2e2 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:28.790362 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-1769711d-c237-44eb-a6ee-af19aa51b2e2 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:28.790815 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-1769711d-c237-44eb-a6ee-af19aa51b2e2 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:28.791240 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-1769711d-c237-44eb-a6ee-af19aa51b2e2 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:28.929394 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-1769711d-c237-44eb-a6ee-af19aa51b2e2 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe6eb38e8df492daaef5755ddea7773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234f69f21d7a456a9ab6a86c4ac2ede2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:47:28.937067 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-1769711d-c237-44eb-a6ee-af19aa51b2e2 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] 10.222.0.52 "GET /compute/v2.1/servers/9705038a-caef-4cf0-ae5f-b6ebcb2dbea6" status: 200 len: 1521 microversion: 2.1 time: 0.159719 Oct 28 09:47:28.937651 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 88/179] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:47:28 2022] GET /compute/v2.1/servers/9705038a-caef-4cf0-ae5f-b6ebcb2dbea6 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:47:29.493297 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-3b043da5-fdc0-422d-9b69-ca14f6897d8d tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:47:29.494635 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-3b043da5-fdc0-422d-9b69-ca14f6897d8d tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] [instance: 86989378-da9a-4b30-98a7-1ce557ef51cb] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:47:29.502053 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-3b043da5-fdc0-422d-9b69-ca14f6897d8d tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:29.502842 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-3b043da5-fdc0-422d-9b69-ca14f6897d8d tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:29.503507 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-3b043da5-fdc0-422d-9b69-ca14f6897d8d tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:29.504403 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-3b043da5-fdc0-422d-9b69-ca14f6897d8d tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:29.504973 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-3b043da5-fdc0-422d-9b69-ca14f6897d8d tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:29.505429 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-3b043da5-fdc0-422d-9b69-ca14f6897d8d tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:29.648925 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-3b043da5-fdc0-422d-9b69-ca14f6897d8d tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36846c3821c14284893e25dd143d11e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1d6189cfd4437a13a0908119c7ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:47:29.659367 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-3b043da5-fdc0-422d-9b69-ca14f6897d8d tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] 10.222.0.52 "GET /compute/v2.1/servers/86989378-da9a-4b30-98a7-1ce557ef51cb" status: 200 len: 1318 microversion: 2.1 time: 0.169936 Oct 28 09:47:29.659985 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 92/180] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:47:29 2022] GET /compute/v2.1/servers/86989378-da9a-4b30-98a7-1ce557ef51cb => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:47:29.960105 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-07b79a1c-8a0a-4f2c-a18c-49412a39fa0e tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:47:29.960777 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-07b79a1c-8a0a-4f2c-a18c-49412a39fa0e tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: 9705038a-caef-4cf0-ae5f-b6ebcb2dbea6] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:47:29.966829 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-07b79a1c-8a0a-4f2c-a18c-49412a39fa0e tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:29.967411 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-07b79a1c-8a0a-4f2c-a18c-49412a39fa0e tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:29.967967 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-07b79a1c-8a0a-4f2c-a18c-49412a39fa0e tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:29.968716 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-07b79a1c-8a0a-4f2c-a18c-49412a39fa0e tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:29.969229 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-07b79a1c-8a0a-4f2c-a18c-49412a39fa0e tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:29.969730 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-07b79a1c-8a0a-4f2c-a18c-49412a39fa0e tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:30.115577 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-07b79a1c-8a0a-4f2c-a18c-49412a39fa0e tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe6eb38e8df492daaef5755ddea7773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234f69f21d7a456a9ab6a86c4ac2ede2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:47:30.123803 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-07b79a1c-8a0a-4f2c-a18c-49412a39fa0e tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] 10.222.0.52 "GET /compute/v2.1/servers/9705038a-caef-4cf0-ae5f-b6ebcb2dbea6" status: 200 len: 1521 microversion: 2.1 time: 0.168271 Oct 28 09:47:30.124317 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 89/181] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:47:29 2022] GET /compute/v2.1/servers/9705038a-caef-4cf0-ae5f-b6ebcb2dbea6 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:47:30.681264 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-6d5bf6a1-b8c8-4c62-8821-b2ba5d4ca475 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:47:30.681899 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-6d5bf6a1-b8c8-4c62-8821-b2ba5d4ca475 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] [instance: 86989378-da9a-4b30-98a7-1ce557ef51cb] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:47:30.688477 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-6d5bf6a1-b8c8-4c62-8821-b2ba5d4ca475 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:30.688962 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-6d5bf6a1-b8c8-4c62-8821-b2ba5d4ca475 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:30.689391 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-6d5bf6a1-b8c8-4c62-8821-b2ba5d4ca475 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:30.690086 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-6d5bf6a1-b8c8-4c62-8821-b2ba5d4ca475 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:30.690539 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-6d5bf6a1-b8c8-4c62-8821-b2ba5d4ca475 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:30.690963 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-6d5bf6a1-b8c8-4c62-8821-b2ba5d4ca475 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:30.823400 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-6d5bf6a1-b8c8-4c62-8821-b2ba5d4ca475 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36846c3821c14284893e25dd143d11e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1d6189cfd4437a13a0908119c7ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:47:30.831774 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-6d5bf6a1-b8c8-4c62-8821-b2ba5d4ca475 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] 10.222.0.52 "GET /compute/v2.1/servers/86989378-da9a-4b30-98a7-1ce557ef51cb" status: 200 len: 1318 microversion: 2.1 time: 0.154229 Oct 28 09:47:30.832548 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 93/182] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:47:30 2022] GET /compute/v2.1/servers/86989378-da9a-4b30-98a7-1ce557ef51cb => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:47:31.150144 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-ae1cf183-f6e3-4bad-84e2-cef05037b045 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:47:31.150751 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-ae1cf183-f6e3-4bad-84e2-cef05037b045 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: 9705038a-caef-4cf0-ae5f-b6ebcb2dbea6] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:47:31.157004 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ae1cf183-f6e3-4bad-84e2-cef05037b045 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:31.157486 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ae1cf183-f6e3-4bad-84e2-cef05037b045 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:31.157920 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ae1cf183-f6e3-4bad-84e2-cef05037b045 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:31.158607 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ae1cf183-f6e3-4bad-84e2-cef05037b045 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:31.159089 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ae1cf183-f6e3-4bad-84e2-cef05037b045 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:31.159511 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ae1cf183-f6e3-4bad-84e2-cef05037b045 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:31.290098 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-ae1cf183-f6e3-4bad-84e2-cef05037b045 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe6eb38e8df492daaef5755ddea7773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234f69f21d7a456a9ab6a86c4ac2ede2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:47:31.297759 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-ae1cf183-f6e3-4bad-84e2-cef05037b045 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] 10.222.0.52 "GET /compute/v2.1/servers/9705038a-caef-4cf0-ae5f-b6ebcb2dbea6" status: 200 len: 1521 microversion: 2.1 time: 0.152104 Oct 28 09:47:31.298325 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 90/183] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:47:31 2022] GET /compute/v2.1/servers/9705038a-caef-4cf0-ae5f-b6ebcb2dbea6 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:47:31.855288 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-467886cb-b98f-46e7-b474-c4e95d0ac8f6 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:47:31.855923 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-467886cb-b98f-46e7-b474-c4e95d0ac8f6 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] [instance: 86989378-da9a-4b30-98a7-1ce557ef51cb] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:47:31.864006 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-467886cb-b98f-46e7-b474-c4e95d0ac8f6 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:31.864572 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-467886cb-b98f-46e7-b474-c4e95d0ac8f6 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:31.865011 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-467886cb-b98f-46e7-b474-c4e95d0ac8f6 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:31.866329 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-467886cb-b98f-46e7-b474-c4e95d0ac8f6 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:31.866787 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-467886cb-b98f-46e7-b474-c4e95d0ac8f6 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:31.867201 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-467886cb-b98f-46e7-b474-c4e95d0ac8f6 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:32.004366 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-467886cb-b98f-46e7-b474-c4e95d0ac8f6 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36846c3821c14284893e25dd143d11e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1d6189cfd4437a13a0908119c7ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:47:32.012418 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-467886cb-b98f-46e7-b474-c4e95d0ac8f6 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] 10.222.0.52 "GET /compute/v2.1/servers/86989378-da9a-4b30-98a7-1ce557ef51cb" status: 200 len: 1318 microversion: 2.1 time: 0.161228 Oct 28 09:47:32.012991 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 94/184] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:47:31 2022] GET /compute/v2.1/servers/86989378-da9a-4b30-98a7-1ce557ef51cb => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:47:32.321494 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-83e6d94e-5a7b-4abe-9c5a-fdef212285c3 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:47:32.322056 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-83e6d94e-5a7b-4abe-9c5a-fdef212285c3 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: 9705038a-caef-4cf0-ae5f-b6ebcb2dbea6] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:47:32.328080 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-83e6d94e-5a7b-4abe-9c5a-fdef212285c3 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:32.328565 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-83e6d94e-5a7b-4abe-9c5a-fdef212285c3 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:32.329237 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-83e6d94e-5a7b-4abe-9c5a-fdef212285c3 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:32.329694 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-83e6d94e-5a7b-4abe-9c5a-fdef212285c3 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:32.330179 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-83e6d94e-5a7b-4abe-9c5a-fdef212285c3 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:32.330598 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-83e6d94e-5a7b-4abe-9c5a-fdef212285c3 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:32.467264 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-83e6d94e-5a7b-4abe-9c5a-fdef212285c3 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe6eb38e8df492daaef5755ddea7773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234f69f21d7a456a9ab6a86c4ac2ede2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:47:32.476978 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-83e6d94e-5a7b-4abe-9c5a-fdef212285c3 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] 10.222.0.52 "GET /compute/v2.1/servers/9705038a-caef-4cf0-ae5f-b6ebcb2dbea6" status: 200 len: 1521 microversion: 2.1 time: 0.158865 Oct 28 09:47:32.477646 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 91/185] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:47:32 2022] GET /compute/v2.1/servers/9705038a-caef-4cf0-ae5f-b6ebcb2dbea6 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:47:33.034533 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-993cfdf2-9675-4e21-a649-3d9bda97e67c tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:47:33.035141 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-993cfdf2-9675-4e21-a649-3d9bda97e67c tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] [instance: 86989378-da9a-4b30-98a7-1ce557ef51cb] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:47:33.042274 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-993cfdf2-9675-4e21-a649-3d9bda97e67c tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:33.042767 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-993cfdf2-9675-4e21-a649-3d9bda97e67c tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:33.043206 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-993cfdf2-9675-4e21-a649-3d9bda97e67c tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:33.043937 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-993cfdf2-9675-4e21-a649-3d9bda97e67c tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:33.044399 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-993cfdf2-9675-4e21-a649-3d9bda97e67c tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:33.044823 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-993cfdf2-9675-4e21-a649-3d9bda97e67c tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:33.181495 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-993cfdf2-9675-4e21-a649-3d9bda97e67c tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36846c3821c14284893e25dd143d11e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1d6189cfd4437a13a0908119c7ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:47:33.189067 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-993cfdf2-9675-4e21-a649-3d9bda97e67c tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] 10.222.0.52 "GET /compute/v2.1/servers/86989378-da9a-4b30-98a7-1ce557ef51cb" status: 200 len: 1318 microversion: 2.1 time: 0.158483 Oct 28 09:47:33.189652 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 95/186] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:47:33 2022] GET /compute/v2.1/servers/86989378-da9a-4b30-98a7-1ce557ef51cb => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:47:33.501732 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-af9936db-2889-4129-9dc1-bb7297c7eea7 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:47:33.502335 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-af9936db-2889-4129-9dc1-bb7297c7eea7 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: 9705038a-caef-4cf0-ae5f-b6ebcb2dbea6] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:47:33.504306 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG dbcounter [-] [127032] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3 {{(pid=127032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:47:33.510336 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-af9936db-2889-4129-9dc1-bb7297c7eea7 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:33.510939 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-af9936db-2889-4129-9dc1-bb7297c7eea7 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:33.511370 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-af9936db-2889-4129-9dc1-bb7297c7eea7 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:33.512082 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-af9936db-2889-4129-9dc1-bb7297c7eea7 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:33.512536 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-af9936db-2889-4129-9dc1-bb7297c7eea7 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:33.512953 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-af9936db-2889-4129-9dc1-bb7297c7eea7 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:33.640727 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-af9936db-2889-4129-9dc1-bb7297c7eea7 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe6eb38e8df492daaef5755ddea7773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234f69f21d7a456a9ab6a86c4ac2ede2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:47:33.648825 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-af9936db-2889-4129-9dc1-bb7297c7eea7 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] 10.222.0.52 "GET /compute/v2.1/servers/9705038a-caef-4cf0-ae5f-b6ebcb2dbea6" status: 200 len: 1521 microversion: 2.1 time: 0.150951 Oct 28 09:47:33.649391 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 92/187] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:47:33 2022] GET /compute/v2.1/servers/9705038a-caef-4cf0-ae5f-b6ebcb2dbea6 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:47:34.213345 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-3bdb04e1-2fde-40f3-b28e-98dfd0b510e0 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:47:34.213952 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-3bdb04e1-2fde-40f3-b28e-98dfd0b510e0 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] [instance: 86989378-da9a-4b30-98a7-1ce557ef51cb] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:47:34.216376 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG dbcounter [-] [127033] Writing DB stats nova_api:SELECT=52 {{(pid=127033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:47:34.221591 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-3bdb04e1-2fde-40f3-b28e-98dfd0b510e0 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:34.222080 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-3bdb04e1-2fde-40f3-b28e-98dfd0b510e0 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:34.222518 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-3bdb04e1-2fde-40f3-b28e-98dfd0b510e0 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:34.223219 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-3bdb04e1-2fde-40f3-b28e-98dfd0b510e0 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:34.223674 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-3bdb04e1-2fde-40f3-b28e-98dfd0b510e0 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:34.224124 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-3bdb04e1-2fde-40f3-b28e-98dfd0b510e0 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:34.360516 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-3bdb04e1-2fde-40f3-b28e-98dfd0b510e0 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36846c3821c14284893e25dd143d11e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1d6189cfd4437a13a0908119c7ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:47:34.368864 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-3bdb04e1-2fde-40f3-b28e-98dfd0b510e0 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] 10.222.0.52 "GET /compute/v2.1/servers/86989378-da9a-4b30-98a7-1ce557ef51cb" status: 200 len: 1318 microversion: 2.1 time: 0.159974 Oct 28 09:47:34.369454 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 96/188] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:47:34 2022] GET /compute/v2.1/servers/86989378-da9a-4b30-98a7-1ce557ef51cb => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:47:34.672126 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-0eec1f75-2037-4a24-9fa1-b1fde4547631 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:47:34.672919 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-0eec1f75-2037-4a24-9fa1-b1fde4547631 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: 9705038a-caef-4cf0-ae5f-b6ebcb2dbea6] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:47:34.678624 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-0eec1f75-2037-4a24-9fa1-b1fde4547631 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:34.679101 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-0eec1f75-2037-4a24-9fa1-b1fde4547631 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:34.679529 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-0eec1f75-2037-4a24-9fa1-b1fde4547631 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:34.680237 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-0eec1f75-2037-4a24-9fa1-b1fde4547631 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:34.680694 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-0eec1f75-2037-4a24-9fa1-b1fde4547631 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:34.681118 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-0eec1f75-2037-4a24-9fa1-b1fde4547631 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:34.810575 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-0eec1f75-2037-4a24-9fa1-b1fde4547631 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe6eb38e8df492daaef5755ddea7773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234f69f21d7a456a9ab6a86c4ac2ede2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:47:34.818581 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-0eec1f75-2037-4a24-9fa1-b1fde4547631 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] 10.222.0.52 "GET /compute/v2.1/servers/9705038a-caef-4cf0-ae5f-b6ebcb2dbea6" status: 200 len: 1521 microversion: 2.1 time: 0.150298 Oct 28 09:47:34.819919 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 93/189] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:47:34 2022] GET /compute/v2.1/servers/9705038a-caef-4cf0-ae5f-b6ebcb2dbea6 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:47:35.392528 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-d14b02e5-9dd5-47d5-8eb8-eb2522633653 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:47:35.393051 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-d14b02e5-9dd5-47d5-8eb8-eb2522633653 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] [instance: 86989378-da9a-4b30-98a7-1ce557ef51cb] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:47:35.400426 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-d14b02e5-9dd5-47d5-8eb8-eb2522633653 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:35.400922 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-d14b02e5-9dd5-47d5-8eb8-eb2522633653 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:35.401354 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-d14b02e5-9dd5-47d5-8eb8-eb2522633653 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:35.402051 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-d14b02e5-9dd5-47d5-8eb8-eb2522633653 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:35.402506 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-d14b02e5-9dd5-47d5-8eb8-eb2522633653 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:35.402929 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-d14b02e5-9dd5-47d5-8eb8-eb2522633653 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:35.543932 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-d14b02e5-9dd5-47d5-8eb8-eb2522633653 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36846c3821c14284893e25dd143d11e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1d6189cfd4437a13a0908119c7ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:47:35.551869 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-d14b02e5-9dd5-47d5-8eb8-eb2522633653 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] 10.222.0.52 "GET /compute/v2.1/servers/86989378-da9a-4b30-98a7-1ce557ef51cb" status: 200 len: 1318 microversion: 2.1 time: 0.163183 Oct 28 09:47:35.552452 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 97/190] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:47:35 2022] GET /compute/v2.1/servers/86989378-da9a-4b30-98a7-1ce557ef51cb => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:47:35.843778 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-75866da6-e7c4-4068-8740-ee44e790d763 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:47:35.844564 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-75866da6-e7c4-4068-8740-ee44e790d763 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: 9705038a-caef-4cf0-ae5f-b6ebcb2dbea6] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:47:35.851630 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-75866da6-e7c4-4068-8740-ee44e790d763 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:35.852146 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-75866da6-e7c4-4068-8740-ee44e790d763 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:35.852608 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-75866da6-e7c4-4068-8740-ee44e790d763 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:35.853300 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-75866da6-e7c4-4068-8740-ee44e790d763 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:35.853753 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-75866da6-e7c4-4068-8740-ee44e790d763 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:35.854172 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-75866da6-e7c4-4068-8740-ee44e790d763 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:36.001635 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-75866da6-e7c4-4068-8740-ee44e790d763 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe6eb38e8df492daaef5755ddea7773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234f69f21d7a456a9ab6a86c4ac2ede2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:47:36.010407 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-75866da6-e7c4-4068-8740-ee44e790d763 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] 10.222.0.52 "GET /compute/v2.1/servers/9705038a-caef-4cf0-ae5f-b6ebcb2dbea6" status: 200 len: 1521 microversion: 2.1 time: 0.170601 Oct 28 09:47:36.011009 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 94/191] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:47:35 2022] GET /compute/v2.1/servers/9705038a-caef-4cf0-ae5f-b6ebcb2dbea6 => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:47:36.574487 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-f0b9666b-2787-4129-8713-3a51852cffb2 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:47:36.575095 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-f0b9666b-2787-4129-8713-3a51852cffb2 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] [instance: 86989378-da9a-4b30-98a7-1ce557ef51cb] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:47:36.581567 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-f0b9666b-2787-4129-8713-3a51852cffb2 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:36.582051 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-f0b9666b-2787-4129-8713-3a51852cffb2 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:36.582479 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-f0b9666b-2787-4129-8713-3a51852cffb2 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:36.583207 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-f0b9666b-2787-4129-8713-3a51852cffb2 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:36.583672 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-f0b9666b-2787-4129-8713-3a51852cffb2 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:36.584109 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-f0b9666b-2787-4129-8713-3a51852cffb2 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:36.714750 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-f0b9666b-2787-4129-8713-3a51852cffb2 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36846c3821c14284893e25dd143d11e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1d6189cfd4437a13a0908119c7ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:47:36.722467 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-f0b9666b-2787-4129-8713-3a51852cffb2 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] 10.222.0.52 "GET /compute/v2.1/servers/86989378-da9a-4b30-98a7-1ce557ef51cb" status: 200 len: 1318 microversion: 2.1 time: 0.151902 Oct 28 09:47:36.723037 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 98/192] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:47:36 2022] GET /compute/v2.1/servers/86989378-da9a-4b30-98a7-1ce557ef51cb => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:47:37.034503 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-1e14e6c7-19ab-4b82-879b-2eb3c7f65b83 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:47:37.035111 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-1e14e6c7-19ab-4b82-879b-2eb3c7f65b83 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: 9705038a-caef-4cf0-ae5f-b6ebcb2dbea6] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:47:37.041800 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-1e14e6c7-19ab-4b82-879b-2eb3c7f65b83 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:37.042266 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-1e14e6c7-19ab-4b82-879b-2eb3c7f65b83 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:37.042697 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-1e14e6c7-19ab-4b82-879b-2eb3c7f65b83 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:37.043382 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-1e14e6c7-19ab-4b82-879b-2eb3c7f65b83 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:37.043863 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-1e14e6c7-19ab-4b82-879b-2eb3c7f65b83 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:37.044291 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-1e14e6c7-19ab-4b82-879b-2eb3c7f65b83 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:37.197526 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-1e14e6c7-19ab-4b82-879b-2eb3c7f65b83 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe6eb38e8df492daaef5755ddea7773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234f69f21d7a456a9ab6a86c4ac2ede2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:47:37.205734 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-1e14e6c7-19ab-4b82-879b-2eb3c7f65b83 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] 10.222.0.52 "GET /compute/v2.1/servers/9705038a-caef-4cf0-ae5f-b6ebcb2dbea6" status: 200 len: 1521 microversion: 2.1 time: 0.175097 Oct 28 09:47:37.206359 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 95/193] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:47:37 2022] GET /compute/v2.1/servers/9705038a-caef-4cf0-ae5f-b6ebcb2dbea6 => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:47:37.745784 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-68ed8c7a-67ee-450c-a3a7-09dadacac081 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:47:37.746388 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-68ed8c7a-67ee-450c-a3a7-09dadacac081 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] [instance: 86989378-da9a-4b30-98a7-1ce557ef51cb] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:47:37.752971 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-68ed8c7a-67ee-450c-a3a7-09dadacac081 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:37.753453 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-68ed8c7a-67ee-450c-a3a7-09dadacac081 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:37.753882 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-68ed8c7a-67ee-450c-a3a7-09dadacac081 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:37.754561 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-68ed8c7a-67ee-450c-a3a7-09dadacac081 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:37.755011 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-68ed8c7a-67ee-450c-a3a7-09dadacac081 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:37.755435 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-68ed8c7a-67ee-450c-a3a7-09dadacac081 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:37.896406 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-68ed8c7a-67ee-450c-a3a7-09dadacac081 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36846c3821c14284893e25dd143d11e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1d6189cfd4437a13a0908119c7ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:47:37.904909 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-68ed8c7a-67ee-450c-a3a7-09dadacac081 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] 10.222.0.52 "GET /compute/v2.1/servers/86989378-da9a-4b30-98a7-1ce557ef51cb" status: 200 len: 1318 microversion: 2.1 time: 0.162891 Oct 28 09:47:37.905870 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 99/194] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:47:37 2022] GET /compute/v2.1/servers/86989378-da9a-4b30-98a7-1ce557ef51cb => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:47:38.003170 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [req-651248ad-797b-47b2-94bc-5204173b8ef1 req-c86ce3ef-1395-448a-92ca-2e900271b088 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86989378-da9a-4b30-98a7-1ce557ef51cb", "name": "network-vif-plugged", "status": "completed", "tag": "a633e606-b877-4581-904e-1301b95df872"}]} {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:47:38.013266 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-651248ad-797b-47b2-94bc-5204173b8ef1 req-c86ce3ef-1395-448a-92ca-2e900271b088 service nova] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:38.013809 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-651248ad-797b-47b2-94bc-5204173b8ef1 req-c86ce3ef-1395-448a-92ca-2e900271b088 service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:38.014235 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-651248ad-797b-47b2-94bc-5204173b8ef1 req-c86ce3ef-1395-448a-92ca-2e900271b088 service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:38.027346 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.compute.server_external_events [req-651248ad-797b-47b2-94bc-5204173b8ef1 req-c86ce3ef-1395-448a-92ca-2e900271b088 service nova] Creating event network-vif-plugged:a633e606-b877-4581-904e-1301b95df872 for instance 86989378-da9a-4b30-98a7-1ce557ef51cb on hv-cinder-zed-3 Oct 28 09:47:38.032571 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [req-651248ad-797b-47b2-94bc-5204173b8ef1 req-c86ce3ef-1395-448a-92ca-2e900271b088 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033144 Oct 28 09:47:38.033570 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 96/195] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Oct 28 09:47:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:47:38.231920 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-8eb2ad2a-7805-41f6-8284-c8dbe139e893 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:47:38.232563 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-8eb2ad2a-7805-41f6-8284-c8dbe139e893 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: 9705038a-caef-4cf0-ae5f-b6ebcb2dbea6] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:47:38.242245 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-8eb2ad2a-7805-41f6-8284-c8dbe139e893 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:38.243260 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-8eb2ad2a-7805-41f6-8284-c8dbe139e893 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:38.244090 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-8eb2ad2a-7805-41f6-8284-c8dbe139e893 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:38.245814 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-8eb2ad2a-7805-41f6-8284-c8dbe139e893 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:38.246686 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-8eb2ad2a-7805-41f6-8284-c8dbe139e893 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:38.247557 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-8eb2ad2a-7805-41f6-8284-c8dbe139e893 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:38.450541 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-8eb2ad2a-7805-41f6-8284-c8dbe139e893 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe6eb38e8df492daaef5755ddea7773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234f69f21d7a456a9ab6a86c4ac2ede2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:47:38.458679 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-8eb2ad2a-7805-41f6-8284-c8dbe139e893 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] 10.222.0.52 "GET /compute/v2.1/servers/9705038a-caef-4cf0-ae5f-b6ebcb2dbea6" status: 200 len: 1521 microversion: 2.1 time: 0.231911 Oct 28 09:47:38.459263 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 100/196] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:47:38 2022] GET /compute/v2.1/servers/9705038a-caef-4cf0-ae5f-b6ebcb2dbea6 => generated 1521 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:47:38.928770 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-70511157-8a0d-4e6a-858f-73c66e75b94c tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:47:38.929453 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-70511157-8a0d-4e6a-858f-73c66e75b94c tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] [instance: 86989378-da9a-4b30-98a7-1ce557ef51cb] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:47:38.935635 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-70511157-8a0d-4e6a-858f-73c66e75b94c tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:38.936140 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-70511157-8a0d-4e6a-858f-73c66e75b94c tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:38.936564 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-70511157-8a0d-4e6a-858f-73c66e75b94c tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:38.937250 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-70511157-8a0d-4e6a-858f-73c66e75b94c tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:38.937697 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-70511157-8a0d-4e6a-858f-73c66e75b94c tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:38.938111 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-70511157-8a0d-4e6a-858f-73c66e75b94c tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:39.072431 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-70511157-8a0d-4e6a-858f-73c66e75b94c tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36846c3821c14284893e25dd143d11e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1d6189cfd4437a13a0908119c7ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:47:39.080611 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-70511157-8a0d-4e6a-858f-73c66e75b94c tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] 10.222.0.52 "GET /compute/v2.1/servers/86989378-da9a-4b30-98a7-1ce557ef51cb" status: 200 len: 1318 microversion: 2.1 time: 0.156039 Oct 28 09:47:39.081225 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 97/197] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:47:38 2022] GET /compute/v2.1/servers/86989378-da9a-4b30-98a7-1ce557ef51cb => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:47:39.482139 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-6a79e815-6405-4c70-8aa6-9e29386782c4 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:47:39.482783 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-6a79e815-6405-4c70-8aa6-9e29386782c4 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: 9705038a-caef-4cf0-ae5f-b6ebcb2dbea6] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:47:39.489648 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-6a79e815-6405-4c70-8aa6-9e29386782c4 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:39.490142 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-6a79e815-6405-4c70-8aa6-9e29386782c4 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:39.490576 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-6a79e815-6405-4c70-8aa6-9e29386782c4 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:39.491280 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-6a79e815-6405-4c70-8aa6-9e29386782c4 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:39.491828 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-6a79e815-6405-4c70-8aa6-9e29386782c4 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:39.492162 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-6a79e815-6405-4c70-8aa6-9e29386782c4 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:39.634610 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-6a79e815-6405-4c70-8aa6-9e29386782c4 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe6eb38e8df492daaef5755ddea7773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234f69f21d7a456a9ab6a86c4ac2ede2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:47:39.642439 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-6a79e815-6405-4c70-8aa6-9e29386782c4 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] 10.222.0.52 "GET /compute/v2.1/servers/9705038a-caef-4cf0-ae5f-b6ebcb2dbea6" status: 200 len: 1521 microversion: 2.1 time: 0.164343 Oct 28 09:47:39.643013 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 101/198] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:47:39 2022] GET /compute/v2.1/servers/9705038a-caef-4cf0-ae5f-b6ebcb2dbea6 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:47:40.103335 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-3fcf4c6b-bbf2-4b77-b400-1e9858a9c9e7 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:47:40.104029 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-3fcf4c6b-bbf2-4b77-b400-1e9858a9c9e7 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] [instance: 86989378-da9a-4b30-98a7-1ce557ef51cb] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:47:40.110374 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-3fcf4c6b-bbf2-4b77-b400-1e9858a9c9e7 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:40.110860 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-3fcf4c6b-bbf2-4b77-b400-1e9858a9c9e7 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:40.111276 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-3fcf4c6b-bbf2-4b77-b400-1e9858a9c9e7 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:40.111992 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-3fcf4c6b-bbf2-4b77-b400-1e9858a9c9e7 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:40.112441 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-3fcf4c6b-bbf2-4b77-b400-1e9858a9c9e7 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:40.112858 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-3fcf4c6b-bbf2-4b77-b400-1e9858a9c9e7 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:40.243289 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-3fcf4c6b-bbf2-4b77-b400-1e9858a9c9e7 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36846c3821c14284893e25dd143d11e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1d6189cfd4437a13a0908119c7ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:47:40.251014 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-3fcf4c6b-bbf2-4b77-b400-1e9858a9c9e7 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] 10.222.0.52 "GET /compute/v2.1/servers/86989378-da9a-4b30-98a7-1ce557ef51cb" status: 200 len: 1318 microversion: 2.1 time: 0.151648 Oct 28 09:47:40.251587 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 98/199] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:47:40 2022] GET /compute/v2.1/servers/86989378-da9a-4b30-98a7-1ce557ef51cb => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:47:40.666619 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-137f25dc-56a6-4bcf-8795-e641b8f51179 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:47:40.667136 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-137f25dc-56a6-4bcf-8795-e641b8f51179 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: 9705038a-caef-4cf0-ae5f-b6ebcb2dbea6] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:47:40.673498 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-137f25dc-56a6-4bcf-8795-e641b8f51179 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:40.673978 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-137f25dc-56a6-4bcf-8795-e641b8f51179 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:40.674410 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-137f25dc-56a6-4bcf-8795-e641b8f51179 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:40.675089 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-137f25dc-56a6-4bcf-8795-e641b8f51179 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:40.675545 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-137f25dc-56a6-4bcf-8795-e641b8f51179 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:40.675996 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-137f25dc-56a6-4bcf-8795-e641b8f51179 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:40.806662 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-137f25dc-56a6-4bcf-8795-e641b8f51179 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe6eb38e8df492daaef5755ddea7773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234f69f21d7a456a9ab6a86c4ac2ede2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:47:40.814301 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-137f25dc-56a6-4bcf-8795-e641b8f51179 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] 10.222.0.52 "GET /compute/v2.1/servers/9705038a-caef-4cf0-ae5f-b6ebcb2dbea6" status: 200 len: 1521 microversion: 2.1 time: 0.151639 Oct 28 09:47:40.814872 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 102/200] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:47:40 2022] GET /compute/v2.1/servers/9705038a-caef-4cf0-ae5f-b6ebcb2dbea6 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:47:41.274603 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-7bdab9be-ef29-47f9-bd92-f1d332bacbb4 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:47:41.275119 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-7bdab9be-ef29-47f9-bd92-f1d332bacbb4 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] [instance: 86989378-da9a-4b30-98a7-1ce557ef51cb] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:47:41.281114 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-7bdab9be-ef29-47f9-bd92-f1d332bacbb4 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:41.281587 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-7bdab9be-ef29-47f9-bd92-f1d332bacbb4 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:41.282016 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-7bdab9be-ef29-47f9-bd92-f1d332bacbb4 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:41.282695 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-7bdab9be-ef29-47f9-bd92-f1d332bacbb4 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:41.283145 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-7bdab9be-ef29-47f9-bd92-f1d332bacbb4 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:41.283565 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-7bdab9be-ef29-47f9-bd92-f1d332bacbb4 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:41.413454 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-7bdab9be-ef29-47f9-bd92-f1d332bacbb4 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36846c3821c14284893e25dd143d11e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1d6189cfd4437a13a0908119c7ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:47:41.421251 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-7bdab9be-ef29-47f9-bd92-f1d332bacbb4 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] 10.222.0.52 "GET /compute/v2.1/servers/86989378-da9a-4b30-98a7-1ce557ef51cb" status: 200 len: 1506 microversion: 2.1 time: 0.150711 Oct 28 09:47:41.421826 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 99/201] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:47:41 2022] GET /compute/v2.1/servers/86989378-da9a-4b30-98a7-1ce557ef51cb => generated 1506 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:47:41.839136 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-63ecba00-436b-4779-a349-0982ea0f3a9d tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:47:41.839930 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-63ecba00-436b-4779-a349-0982ea0f3a9d tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: 9705038a-caef-4cf0-ae5f-b6ebcb2dbea6] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:47:41.846850 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-63ecba00-436b-4779-a349-0982ea0f3a9d tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:41.847352 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-63ecba00-436b-4779-a349-0982ea0f3a9d tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:41.847804 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-63ecba00-436b-4779-a349-0982ea0f3a9d tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:41.848537 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-63ecba00-436b-4779-a349-0982ea0f3a9d tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:41.848991 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-63ecba00-436b-4779-a349-0982ea0f3a9d tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:41.849443 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-63ecba00-436b-4779-a349-0982ea0f3a9d tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:41.990601 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-63ecba00-436b-4779-a349-0982ea0f3a9d tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe6eb38e8df492daaef5755ddea7773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234f69f21d7a456a9ab6a86c4ac2ede2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:47:41.998585 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-63ecba00-436b-4779-a349-0982ea0f3a9d tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] 10.222.0.52 "GET /compute/v2.1/servers/9705038a-caef-4cf0-ae5f-b6ebcb2dbea6" status: 200 len: 1521 microversion: 2.1 time: 0.164881 Oct 28 09:47:41.999171 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 103/202] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:47:41 2022] GET /compute/v2.1/servers/9705038a-caef-4cf0-ae5f-b6ebcb2dbea6 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:47:43.021283 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-0ca01712-0ba9-4f77-9a8d-fff295fdd47e tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:47:43.021892 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-0ca01712-0ba9-4f77-9a8d-fff295fdd47e tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: 9705038a-caef-4cf0-ae5f-b6ebcb2dbea6] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:47:43.028112 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-0ca01712-0ba9-4f77-9a8d-fff295fdd47e tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:43.028628 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-0ca01712-0ba9-4f77-9a8d-fff295fdd47e tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:43.029059 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-0ca01712-0ba9-4f77-9a8d-fff295fdd47e tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:43.029748 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-0ca01712-0ba9-4f77-9a8d-fff295fdd47e tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:43.030203 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-0ca01712-0ba9-4f77-9a8d-fff295fdd47e tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:43.030625 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-0ca01712-0ba9-4f77-9a8d-fff295fdd47e tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:43.162346 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-0ca01712-0ba9-4f77-9a8d-fff295fdd47e tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe6eb38e8df492daaef5755ddea7773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234f69f21d7a456a9ab6a86c4ac2ede2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:47:43.171502 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-0ca01712-0ba9-4f77-9a8d-fff295fdd47e tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] 10.222.0.52 "GET /compute/v2.1/servers/9705038a-caef-4cf0-ae5f-b6ebcb2dbea6" status: 200 len: 1521 microversion: 2.1 time: 0.154059 Oct 28 09:47:43.172180 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 100/203] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:47:43 2022] GET /compute/v2.1/servers/9705038a-caef-4cf0-ae5f-b6ebcb2dbea6 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:47:44.196392 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-d19bc04a-9c5e-472c-8998-f9cfc1d3e310 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:47:44.197033 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-d19bc04a-9c5e-472c-8998-f9cfc1d3e310 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: 9705038a-caef-4cf0-ae5f-b6ebcb2dbea6] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:47:44.203445 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-d19bc04a-9c5e-472c-8998-f9cfc1d3e310 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:44.203975 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-d19bc04a-9c5e-472c-8998-f9cfc1d3e310 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:44.204412 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-d19bc04a-9c5e-472c-8998-f9cfc1d3e310 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:44.205131 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-d19bc04a-9c5e-472c-8998-f9cfc1d3e310 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:44.205565 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-d19bc04a-9c5e-472c-8998-f9cfc1d3e310 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:44.205986 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-d19bc04a-9c5e-472c-8998-f9cfc1d3e310 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:44.226259 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG dbcounter [-] [127033] Writing DB stats nova_cell1:SELECT=100 {{(pid=127033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:47:44.342376 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-d19bc04a-9c5e-472c-8998-f9cfc1d3e310 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe6eb38e8df492daaef5755ddea7773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234f69f21d7a456a9ab6a86c4ac2ede2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:47:44.350283 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-d19bc04a-9c5e-472c-8998-f9cfc1d3e310 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] 10.222.0.52 "GET /compute/v2.1/servers/9705038a-caef-4cf0-ae5f-b6ebcb2dbea6" status: 200 len: 1521 microversion: 2.1 time: 0.158466 Oct 28 09:47:44.351498 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 104/204] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:47:44 2022] GET /compute/v2.1/servers/9705038a-caef-4cf0-ae5f-b6ebcb2dbea6 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:47:45.373826 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-68fea5b9-5023-4b80-8d1e-1bd32a666645 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:47:45.374431 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-68fea5b9-5023-4b80-8d1e-1bd32a666645 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: 9705038a-caef-4cf0-ae5f-b6ebcb2dbea6] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:47:45.380855 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-68fea5b9-5023-4b80-8d1e-1bd32a666645 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:45.381340 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-68fea5b9-5023-4b80-8d1e-1bd32a666645 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:45.381767 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-68fea5b9-5023-4b80-8d1e-1bd32a666645 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:45.382455 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-68fea5b9-5023-4b80-8d1e-1bd32a666645 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:45.382907 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-68fea5b9-5023-4b80-8d1e-1bd32a666645 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:45.383327 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-68fea5b9-5023-4b80-8d1e-1bd32a666645 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:45.514779 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-68fea5b9-5023-4b80-8d1e-1bd32a666645 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe6eb38e8df492daaef5755ddea7773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234f69f21d7a456a9ab6a86c4ac2ede2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:47:45.517106 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG dbcounter [-] [127032] Writing DB stats nova_cell1:SELECT=100 {{(pid=127032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:47:45.523926 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-68fea5b9-5023-4b80-8d1e-1bd32a666645 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] 10.222.0.52 "GET /compute/v2.1/servers/9705038a-caef-4cf0-ae5f-b6ebcb2dbea6" status: 200 len: 1521 microversion: 2.1 time: 0.153932 Oct 28 09:47:45.524499 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 101/205] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:47:45 2022] GET /compute/v2.1/servers/9705038a-caef-4cf0-ae5f-b6ebcb2dbea6 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:47:46.546935 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-5762a165-e5c1-4917-bca0-798ced026c2e tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:47:46.547461 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-5762a165-e5c1-4917-bca0-798ced026c2e tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: 9705038a-caef-4cf0-ae5f-b6ebcb2dbea6] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:47:46.554572 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-5762a165-e5c1-4917-bca0-798ced026c2e tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:46.555056 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-5762a165-e5c1-4917-bca0-798ced026c2e tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:46.555489 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-5762a165-e5c1-4917-bca0-798ced026c2e tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:46.556310 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-5762a165-e5c1-4917-bca0-798ced026c2e tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:46.556772 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-5762a165-e5c1-4917-bca0-798ced026c2e tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:46.557194 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-5762a165-e5c1-4917-bca0-798ced026c2e tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:46.705056 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-5762a165-e5c1-4917-bca0-798ced026c2e tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe6eb38e8df492daaef5755ddea7773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234f69f21d7a456a9ab6a86c4ac2ede2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:47:46.713399 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-5762a165-e5c1-4917-bca0-798ced026c2e tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] 10.222.0.52 "GET /compute/v2.1/servers/9705038a-caef-4cf0-ae5f-b6ebcb2dbea6" status: 200 len: 1521 microversion: 2.1 time: 0.170407 Oct 28 09:47:46.713995 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 105/206] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:47:46 2022] GET /compute/v2.1/servers/9705038a-caef-4cf0-ae5f-b6ebcb2dbea6 => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:47:47.738861 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-9b9c9554-b97b-4da3-8493-da5b321af390 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:47:47.739672 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-9b9c9554-b97b-4da3-8493-da5b321af390 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: 9705038a-caef-4cf0-ae5f-b6ebcb2dbea6] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:47:47.746652 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-9b9c9554-b97b-4da3-8493-da5b321af390 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:47.747236 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-9b9c9554-b97b-4da3-8493-da5b321af390 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:47.747734 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-9b9c9554-b97b-4da3-8493-da5b321af390 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:47.748543 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-9b9c9554-b97b-4da3-8493-da5b321af390 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:47.749067 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-9b9c9554-b97b-4da3-8493-da5b321af390 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:47.749571 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-9b9c9554-b97b-4da3-8493-da5b321af390 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:47.943325 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-9b9c9554-b97b-4da3-8493-da5b321af390 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe6eb38e8df492daaef5755ddea7773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234f69f21d7a456a9ab6a86c4ac2ede2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:47:47.951425 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-9b9c9554-b97b-4da3-8493-da5b321af390 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] 10.222.0.52 "GET /compute/v2.1/servers/9705038a-caef-4cf0-ae5f-b6ebcb2dbea6" status: 200 len: 1521 microversion: 2.1 time: 0.217541 Oct 28 09:47:47.952160 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 102/207] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:47:47 2022] GET /compute/v2.1/servers/9705038a-caef-4cf0-ae5f-b6ebcb2dbea6 => generated 1521 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:47:48.976325 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-81d0a289-0840-4dec-bde4-147869ee21fc tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:47:48.977125 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-81d0a289-0840-4dec-bde4-147869ee21fc tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: 9705038a-caef-4cf0-ae5f-b6ebcb2dbea6] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:47:48.985788 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-81d0a289-0840-4dec-bde4-147869ee21fc tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:48.986569 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-81d0a289-0840-4dec-bde4-147869ee21fc tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:48.987326 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-81d0a289-0840-4dec-bde4-147869ee21fc tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:48.988171 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-81d0a289-0840-4dec-bde4-147869ee21fc tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:48.989477 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-81d0a289-0840-4dec-bde4-147869ee21fc tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:48.989967 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-81d0a289-0840-4dec-bde4-147869ee21fc tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:49.137479 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-81d0a289-0840-4dec-bde4-147869ee21fc tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe6eb38e8df492daaef5755ddea7773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234f69f21d7a456a9ab6a86c4ac2ede2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:47:49.146100 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-81d0a289-0840-4dec-bde4-147869ee21fc tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] 10.222.0.52 "GET /compute/v2.1/servers/9705038a-caef-4cf0-ae5f-b6ebcb2dbea6" status: 200 len: 1521 microversion: 2.1 time: 0.174030 Oct 28 09:47:49.148041 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 106/208] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:47:48 2022] GET /compute/v2.1/servers/9705038a-caef-4cf0-ae5f-b6ebcb2dbea6 => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:47:50.171427 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-47c6f79c-94fa-4141-b2ac-c3691c513cd7 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:47:50.172158 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-47c6f79c-94fa-4141-b2ac-c3691c513cd7 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: 9705038a-caef-4cf0-ae5f-b6ebcb2dbea6] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:47:50.179154 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-47c6f79c-94fa-4141-b2ac-c3691c513cd7 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:50.179545 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-47c6f79c-94fa-4141-b2ac-c3691c513cd7 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:50.180015 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-47c6f79c-94fa-4141-b2ac-c3691c513cd7 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:50.180719 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-47c6f79c-94fa-4141-b2ac-c3691c513cd7 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:50.181176 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-47c6f79c-94fa-4141-b2ac-c3691c513cd7 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:50.181583 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-47c6f79c-94fa-4141-b2ac-c3691c513cd7 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:50.325202 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-47c6f79c-94fa-4141-b2ac-c3691c513cd7 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe6eb38e8df492daaef5755ddea7773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234f69f21d7a456a9ab6a86c4ac2ede2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:47:50.336057 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-47c6f79c-94fa-4141-b2ac-c3691c513cd7 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] 10.222.0.52 "GET /compute/v2.1/servers/9705038a-caef-4cf0-ae5f-b6ebcb2dbea6" status: 200 len: 1521 microversion: 2.1 time: 0.168846 Oct 28 09:47:50.336800 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 103/209] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:47:50 2022] GET /compute/v2.1/servers/9705038a-caef-4cf0-ae5f-b6ebcb2dbea6 => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:47:51.369337 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-51c654d6-32d3-40ad-a5bd-a9356be3a714 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:47:51.369980 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-51c654d6-32d3-40ad-a5bd-a9356be3a714 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: 9705038a-caef-4cf0-ae5f-b6ebcb2dbea6] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:47:51.377728 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-51c654d6-32d3-40ad-a5bd-a9356be3a714 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:51.378586 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-51c654d6-32d3-40ad-a5bd-a9356be3a714 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:51.379080 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-51c654d6-32d3-40ad-a5bd-a9356be3a714 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:51.380115 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-51c654d6-32d3-40ad-a5bd-a9356be3a714 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:51.380961 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-51c654d6-32d3-40ad-a5bd-a9356be3a714 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:51.382080 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-51c654d6-32d3-40ad-a5bd-a9356be3a714 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:51.721891 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-51c654d6-32d3-40ad-a5bd-a9356be3a714 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe6eb38e8df492daaef5755ddea7773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234f69f21d7a456a9ab6a86c4ac2ede2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:47:51.732289 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-51c654d6-32d3-40ad-a5bd-a9356be3a714 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] 10.222.0.52 "GET /compute/v2.1/servers/9705038a-caef-4cf0-ae5f-b6ebcb2dbea6" status: 200 len: 1521 microversion: 2.1 time: 0.369136 Oct 28 09:47:51.732881 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 107/210] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:47:51 2022] GET /compute/v2.1/servers/9705038a-caef-4cf0-ae5f-b6ebcb2dbea6 => generated 1521 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:47:52.757645 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-002fe1c2-8d8c-48b1-a380-81655264fc2f tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:47:52.759053 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-002fe1c2-8d8c-48b1-a380-81655264fc2f tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: 9705038a-caef-4cf0-ae5f-b6ebcb2dbea6] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:47:52.766389 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-002fe1c2-8d8c-48b1-a380-81655264fc2f tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:52.767090 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-002fe1c2-8d8c-48b1-a380-81655264fc2f tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:52.767726 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-002fe1c2-8d8c-48b1-a380-81655264fc2f tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:52.768673 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-002fe1c2-8d8c-48b1-a380-81655264fc2f tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:52.769328 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-002fe1c2-8d8c-48b1-a380-81655264fc2f tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:52.769977 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-002fe1c2-8d8c-48b1-a380-81655264fc2f tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:52.983708 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-002fe1c2-8d8c-48b1-a380-81655264fc2f tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe6eb38e8df492daaef5755ddea7773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234f69f21d7a456a9ab6a86c4ac2ede2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:47:52.996974 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-002fe1c2-8d8c-48b1-a380-81655264fc2f tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] 10.222.0.52 "GET /compute/v2.1/servers/9705038a-caef-4cf0-ae5f-b6ebcb2dbea6" status: 200 len: 1521 microversion: 2.1 time: 0.244612 Oct 28 09:47:52.998026 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 104/211] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:47:52 2022] GET /compute/v2.1/servers/9705038a-caef-4cf0-ae5f-b6ebcb2dbea6 => generated 1521 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:47:54.025779 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-7de883a2-fdfe-4b70-ad6e-d23ee404db97 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:47:54.026397 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-7de883a2-fdfe-4b70-ad6e-d23ee404db97 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: 9705038a-caef-4cf0-ae5f-b6ebcb2dbea6] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:47:54.034248 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-7de883a2-fdfe-4b70-ad6e-d23ee404db97 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:54.034920 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-7de883a2-fdfe-4b70-ad6e-d23ee404db97 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:54.035520 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-7de883a2-fdfe-4b70-ad6e-d23ee404db97 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:54.036407 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-7de883a2-fdfe-4b70-ad6e-d23ee404db97 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:54.036918 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-7de883a2-fdfe-4b70-ad6e-d23ee404db97 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:54.037474 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-7de883a2-fdfe-4b70-ad6e-d23ee404db97 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:54.194694 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-7de883a2-fdfe-4b70-ad6e-d23ee404db97 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe6eb38e8df492daaef5755ddea7773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234f69f21d7a456a9ab6a86c4ac2ede2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:47:54.202582 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-7de883a2-fdfe-4b70-ad6e-d23ee404db97 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] 10.222.0.52 "GET /compute/v2.1/servers/9705038a-caef-4cf0-ae5f-b6ebcb2dbea6" status: 200 len: 1521 microversion: 2.1 time: 0.182122 Oct 28 09:47:54.203156 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 108/212] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:47:54 2022] GET /compute/v2.1/servers/9705038a-caef-4cf0-ae5f-b6ebcb2dbea6 => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:47:55.236419 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-eb070be8-75f6-46a4-b939-c47d4e753394 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:47:55.240434 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-eb070be8-75f6-46a4-b939-c47d4e753394 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: 9705038a-caef-4cf0-ae5f-b6ebcb2dbea6] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:47:55.259003 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-eb070be8-75f6-46a4-b939-c47d4e753394 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:55.259506 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-eb070be8-75f6-46a4-b939-c47d4e753394 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:55.260212 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-eb070be8-75f6-46a4-b939-c47d4e753394 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:55.260916 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-eb070be8-75f6-46a4-b939-c47d4e753394 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:55.266240 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-eb070be8-75f6-46a4-b939-c47d4e753394 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:55.266683 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-eb070be8-75f6-46a4-b939-c47d4e753394 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:55.436996 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-eb070be8-75f6-46a4-b939-c47d4e753394 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe6eb38e8df492daaef5755ddea7773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234f69f21d7a456a9ab6a86c4ac2ede2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:47:55.445833 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-eb070be8-75f6-46a4-b939-c47d4e753394 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] 10.222.0.52 "GET /compute/v2.1/servers/9705038a-caef-4cf0-ae5f-b6ebcb2dbea6" status: 200 len: 1501 microversion: 2.1 time: 0.221898 Oct 28 09:47:55.446424 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 105/213] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:47:55 2022] GET /compute/v2.1/servers/9705038a-caef-4cf0-ae5f-b6ebcb2dbea6 => generated 1501 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:47:55.468392 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-f5c76569-c656-4576-876c-d47c641cfaa9 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:47:55.469007 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-f5c76569-c656-4576-876c-d47c641cfaa9 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: 1eaf7cc8-63d3-40c6-b5f5-e4e978ddfe17] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:47:55.475562 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-f5c76569-c656-4576-876c-d47c641cfaa9 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:55.476099 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-f5c76569-c656-4576-876c-d47c641cfaa9 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:55.476745 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-f5c76569-c656-4576-876c-d47c641cfaa9 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:55.477614 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-f5c76569-c656-4576-876c-d47c641cfaa9 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:55.478351 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-f5c76569-c656-4576-876c-d47c641cfaa9 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:55.478622 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-f5c76569-c656-4576-876c-d47c641cfaa9 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:55.641366 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-f5c76569-c656-4576-876c-d47c641cfaa9 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe6eb38e8df492daaef5755ddea7773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234f69f21d7a456a9ab6a86c4ac2ede2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:47:55.655890 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-f5c76569-c656-4576-876c-d47c641cfaa9 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] 10.222.0.52 "GET /compute/v2.1/servers/1eaf7cc8-63d3-40c6-b5f5-e4e978ddfe17" status: 200 len: 1516 microversion: 2.1 time: 0.191217 Oct 28 09:47:55.656666 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 109/214] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:47:55 2022] GET /compute/v2.1/servers/1eaf7cc8-63d3-40c6-b5f5-e4e978ddfe17 => generated 1516 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:47:57.914987 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-97e39f5b-bfe4-4e7b-bc34-1d4b6eb87afa tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1056957414", "imageRef": "6e314146-a2ed-4f8b-afdd-4f7ed1184d20", "flavorRef": "452", "networks": [{"uuid": "c90d134e-a442-4b9c-99a6-a23ffbc80806"}]}} {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:47:57.969945 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.network.neutron [None req-97e39f5b-bfe4-4e7b-bc34-1d4b6eb87afa tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] validate_networks() for [('c90d134e-a442-4b9c-99a6-a23ffbc80806', None, None, None, None, None)] {{(pid=127032) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 09:47:58.108543 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-c6cd8b7b-27b5-40ae-8c91-061eb5246421 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:47:58.110922 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-c6cd8b7b-27b5-40ae-8c91-061eb5246421 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: 1eaf7cc8-63d3-40c6-b5f5-e4e978ddfe17] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:47:58.118010 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-c6cd8b7b-27b5-40ae-8c91-061eb5246421 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:58.118500 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-c6cd8b7b-27b5-40ae-8c91-061eb5246421 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:58.118931 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-c6cd8b7b-27b5-40ae-8c91-061eb5246421 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:58.120276 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-c6cd8b7b-27b5-40ae-8c91-061eb5246421 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:58.120276 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-c6cd8b7b-27b5-40ae-8c91-061eb5246421 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:58.120520 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-c6cd8b7b-27b5-40ae-8c91-061eb5246421 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:58.150195 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.objects.instance [None req-c6cd8b7b-27b5-40ae-8c91-061eb5246421 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lazy-loading 'flavor' on Instance uuid 1eaf7cc8-63d3-40c6-b5f5-e4e978ddfe17 {{(pid=127033) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:47:58.293939 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-c6cd8b7b-27b5-40ae-8c91-061eb5246421 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] 10.222.0.52 "POST /compute/v2.1/servers/1eaf7cc8-63d3-40c6-b5f5-e4e978ddfe17/action" status: 200 len: 32 microversion: 2.1 time: 0.189633 Oct 28 09:47:58.294728 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 110/215] 10.222.0.52 () {60 vars in 1278 bytes} [Fri Oct 28 09:47:58 2022] POST /compute/v2.1/servers/1eaf7cc8-63d3-40c6-b5f5-e4e978ddfe17/action => generated 32 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 28 09:47:58.310225 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-8f737baf-f22d-40da-a6c3-1439016cf0f9 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:47:58.311506 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-8f737baf-f22d-40da-a6c3-1439016cf0f9 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: 1eaf7cc8-63d3-40c6-b5f5-e4e978ddfe17] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:47:58.318422 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-8f737baf-f22d-40da-a6c3-1439016cf0f9 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:58.320263 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-8f737baf-f22d-40da-a6c3-1439016cf0f9 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:58.320696 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-8f737baf-f22d-40da-a6c3-1439016cf0f9 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:58.321408 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-8f737baf-f22d-40da-a6c3-1439016cf0f9 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:58.321847 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-8f737baf-f22d-40da-a6c3-1439016cf0f9 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:58.322399 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-8f737baf-f22d-40da-a6c3-1439016cf0f9 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:58.380622 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.virt.hardware [None req-97e39f5b-bfe4-4e7b-bc34-1d4b6eb87afa tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Flavor limits 0:0:0 {{(pid=127032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 09:47:58.381870 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.virt.hardware [None req-97e39f5b-bfe4-4e7b-bc34-1d4b6eb87afa tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Image limits 0:0:0 {{(pid=127032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 09:47:58.382568 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.virt.hardware [None req-97e39f5b-bfe4-4e7b-bc34-1d4b6eb87afa tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Flavor pref 0:0:0 {{(pid=127032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 09:47:58.383176 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.virt.hardware [None req-97e39f5b-bfe4-4e7b-bc34-1d4b6eb87afa tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Image pref 0:0:0 {{(pid=127032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 09:47:58.383816 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.virt.hardware [None req-97e39f5b-bfe4-4e7b-bc34-1d4b6eb87afa tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 09:47:58.394646 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-97e39f5b-bfe4-4e7b-bc34-1d4b6eb87afa tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:58.395387 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-97e39f5b-bfe4-4e7b-bc34-1d4b6eb87afa tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:58.396068 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-97e39f5b-bfe4-4e7b-bc34-1d4b6eb87afa tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:58.397572 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-97e39f5b-bfe4-4e7b-bc34-1d4b6eb87afa tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:58.398454 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-97e39f5b-bfe4-4e7b-bc34-1d4b6eb87afa tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:58.399128 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-97e39f5b-bfe4-4e7b-bc34-1d4b6eb87afa tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:58.419511 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.quota [None req-97e39f5b-bfe4-4e7b-bc34-1d4b6eb87afa tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Getting quotas for project 2aa6bd99403b4421acb8bd714c9450c6. Resources: {'cores', 'ram', 'instances'} {{(pid=127032) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 09:47:58.425340 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.quota [None req-97e39f5b-bfe4-4e7b-bc34-1d4b6eb87afa tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Getting quotas for user d10c1b55b5c04ba380ed8ffdaa462bc7 and project 2aa6bd99403b4421acb8bd714c9450c6. Resources: {'cores', 'ram', 'instances'} {{(pid=127032) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 09:47:58.439423 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-97e39f5b-bfe4-4e7b-bc34-1d4b6eb87afa tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Going to run 1 instances... {{(pid=127032) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 09:47:58.443241 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-97e39f5b-bfe4-4e7b-bc34-1d4b6eb87afa tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] [instance: 0e97301c-3a01-452d-b54a-6bf66c4793d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e314146-a2ed-4f8b-afdd-4f7ed1184d20',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127032) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 09:47:58.502431 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-97e39f5b-bfe4-4e7b-bc34-1d4b6eb87afa tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.592135 Oct 28 09:47:58.503587 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 106/216] 10.222.0.52 () {60 vars in 1147 bytes} [Fri Oct 28 09:47:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 594 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 09:47:58.518007 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-12547380-4e6f-4605-8617-4f3503a603a5 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:47:58.519173 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-12547380-4e6f-4605-8617-4f3503a603a5 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] [instance: 0e97301c-3a01-452d-b54a-6bf66c4793d9] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:47:58.625061 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-12547380-4e6f-4605-8617-4f3503a603a5 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c1b55b5c04ba380ed8ffdaa462bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa6bd99403b4421acb8bd714c9450c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:47:58.640108 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-12547380-4e6f-4605-8617-4f3503a603a5 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] 10.222.0.52 "GET /compute/v2.1/servers/0e97301c-3a01-452d-b54a-6bf66c4793d9" status: 200 len: 1214 microversion: 2.1 time: 0.121926 Oct 28 09:47:58.640108 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 107/217] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:47:58 2022] GET /compute/v2.1/servers/0e97301c-3a01-452d-b54a-6bf66c4793d9 => generated 1214 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:47:58.726622 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-8f737baf-f22d-40da-a6c3-1439016cf0f9 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe6eb38e8df492daaef5755ddea7773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234f69f21d7a456a9ab6a86c4ac2ede2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:47:58.735601 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-8f737baf-f22d-40da-a6c3-1439016cf0f9 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] 10.222.0.52 "GET /compute/v2.1/servers/1eaf7cc8-63d3-40c6-b5f5-e4e978ddfe17" status: 200 len: 1522 microversion: 2.1 time: 0.430272 Oct 28 09:47:58.736956 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 111/218] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:47:58 2022] GET /compute/v2.1/servers/1eaf7cc8-63d3-40c6-b5f5-e4e978ddfe17 => generated 1522 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:47:59.660228 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-7e69967f-3b44-429d-b8c9-a71e64937a7c tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:47:59.660845 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-7e69967f-3b44-429d-b8c9-a71e64937a7c tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] [instance: 0e97301c-3a01-452d-b54a-6bf66c4793d9] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:47:59.669029 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-7e69967f-3b44-429d-b8c9-a71e64937a7c tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:59.669523 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-7e69967f-3b44-429d-b8c9-a71e64937a7c tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:59.669954 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-7e69967f-3b44-429d-b8c9-a71e64937a7c tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:59.670656 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-7e69967f-3b44-429d-b8c9-a71e64937a7c tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:59.671110 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-7e69967f-3b44-429d-b8c9-a71e64937a7c tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:59.671529 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-7e69967f-3b44-429d-b8c9-a71e64937a7c tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:59.740331 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-7e69967f-3b44-429d-b8c9-a71e64937a7c tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c1b55b5c04ba380ed8ffdaa462bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa6bd99403b4421acb8bd714c9450c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:47:59.748915 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-7e69967f-3b44-429d-b8c9-a71e64937a7c tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] 10.222.0.52 "GET /compute/v2.1/servers/0e97301c-3a01-452d-b54a-6bf66c4793d9" status: 200 len: 1266 microversion: 2.1 time: 0.094589 Oct 28 09:47:59.749499 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 108/219] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:47:59 2022] GET /compute/v2.1/servers/0e97301c-3a01-452d-b54a-6bf66c4793d9 => generated 1266 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:47:59.779216 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-a6994e3b-2506-4acb-88b6-5faf344064e6 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:47:59.779843 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-a6994e3b-2506-4acb-88b6-5faf344064e6 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: 1eaf7cc8-63d3-40c6-b5f5-e4e978ddfe17] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:47:59.786192 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-a6994e3b-2506-4acb-88b6-5faf344064e6 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:59.786671 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-a6994e3b-2506-4acb-88b6-5faf344064e6 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:59.787096 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-a6994e3b-2506-4acb-88b6-5faf344064e6 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:59.787972 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-a6994e3b-2506-4acb-88b6-5faf344064e6 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:47:59.788565 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-a6994e3b-2506-4acb-88b6-5faf344064e6 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:47:59.788686 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-a6994e3b-2506-4acb-88b6-5faf344064e6 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:47:59.932878 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-a6994e3b-2506-4acb-88b6-5faf344064e6 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe6eb38e8df492daaef5755ddea7773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234f69f21d7a456a9ab6a86c4ac2ede2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:47:59.940535 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-a6994e3b-2506-4acb-88b6-5faf344064e6 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] 10.222.0.52 "GET /compute/v2.1/servers/1eaf7cc8-63d3-40c6-b5f5-e4e978ddfe17" status: 200 len: 1522 microversion: 2.1 time: 0.165113 Oct 28 09:47:59.941106 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 112/220] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:47:59 2022] GET /compute/v2.1/servers/1eaf7cc8-63d3-40c6-b5f5-e4e978ddfe17 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:48:00.779631 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-7af96464-3eaa-455d-912d-692a0cf81ac0 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:00.781733 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-7af96464-3eaa-455d-912d-692a0cf81ac0 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] [instance: 0e97301c-3a01-452d-b54a-6bf66c4793d9] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:00.793981 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-7af96464-3eaa-455d-912d-692a0cf81ac0 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:00.794859 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-7af96464-3eaa-455d-912d-692a0cf81ac0 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:00.795967 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-7af96464-3eaa-455d-912d-692a0cf81ac0 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:00.797705 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-7af96464-3eaa-455d-912d-692a0cf81ac0 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:00.798739 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-7af96464-3eaa-455d-912d-692a0cf81ac0 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:00.799547 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-7af96464-3eaa-455d-912d-692a0cf81ac0 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:00.964260 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-2494143b-bb40-4a0f-90f8-084122e899ae tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:00.964867 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-2494143b-bb40-4a0f-90f8-084122e899ae tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: 1eaf7cc8-63d3-40c6-b5f5-e4e978ddfe17] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:00.971580 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-2494143b-bb40-4a0f-90f8-084122e899ae tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:00.972360 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-2494143b-bb40-4a0f-90f8-084122e899ae tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:00.973026 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-2494143b-bb40-4a0f-90f8-084122e899ae tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:00.973919 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-2494143b-bb40-4a0f-90f8-084122e899ae tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:00.974537 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-2494143b-bb40-4a0f-90f8-084122e899ae tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:00.976378 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-2494143b-bb40-4a0f-90f8-084122e899ae tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:00.987472 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-7af96464-3eaa-455d-912d-692a0cf81ac0 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c1b55b5c04ba380ed8ffdaa462bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa6bd99403b4421acb8bd714c9450c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:00.998079 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-7af96464-3eaa-455d-912d-692a0cf81ac0 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] 10.222.0.52 "GET /compute/v2.1/servers/0e97301c-3a01-452d-b54a-6bf66c4793d9" status: 200 len: 1314 microversion: 2.1 time: 0.228117 Oct 28 09:48:00.998936 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 109/221] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:48:00 2022] GET /compute/v2.1/servers/0e97301c-3a01-452d-b54a-6bf66c4793d9 => generated 1314 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:48:01.120117 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-2494143b-bb40-4a0f-90f8-084122e899ae tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe6eb38e8df492daaef5755ddea7773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234f69f21d7a456a9ab6a86c4ac2ede2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:01.127675 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-2494143b-bb40-4a0f-90f8-084122e899ae tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] 10.222.0.52 "GET /compute/v2.1/servers/1eaf7cc8-63d3-40c6-b5f5-e4e978ddfe17" status: 200 len: 1522 microversion: 2.1 time: 0.168008 Oct 28 09:48:01.128495 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 113/222] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:48:00 2022] GET /compute/v2.1/servers/1eaf7cc8-63d3-40c6-b5f5-e4e978ddfe17 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:48:01.548533 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [req-9663cf86-ed6a-467e-9540-6aa318eb94b9 req-e7850d19-a661-45dc-9b10-848720945079 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e97301c-3a01-452d-b54a-6bf66c4793d9", "tag": "bbde4e9b-6519-4264-9bd3-d11d2c951c54"}]} {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:48:01.560042 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-9663cf86-ed6a-467e-9540-6aa318eb94b9 req-e7850d19-a661-45dc-9b10-848720945079 service nova] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:01.560923 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-9663cf86-ed6a-467e-9540-6aa318eb94b9 req-e7850d19-a661-45dc-9b10-848720945079 service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:01.561353 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-9663cf86-ed6a-467e-9540-6aa318eb94b9 req-e7850d19-a661-45dc-9b10-848720945079 service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:01.578016 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.compute.server_external_events [req-9663cf86-ed6a-467e-9540-6aa318eb94b9 req-e7850d19-a661-45dc-9b10-848720945079 service nova] Creating event network-changed:bbde4e9b-6519-4264-9bd3-d11d2c951c54 for instance 0e97301c-3a01-452d-b54a-6bf66c4793d9 on hv-cinder-zed-3 Oct 28 09:48:01.583534 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [req-9663cf86-ed6a-467e-9540-6aa318eb94b9 req-e7850d19-a661-45dc-9b10-848720945079 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038612 Oct 28 09:48:01.584230 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 110/223] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Oct 28 09:48:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:48:02.021041 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-6e88fd0e-875d-47f5-90f6-653c4e3c5c68 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:02.021647 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-6e88fd0e-875d-47f5-90f6-653c4e3c5c68 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] [instance: 0e97301c-3a01-452d-b54a-6bf66c4793d9] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:02.028696 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-6e88fd0e-875d-47f5-90f6-653c4e3c5c68 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:02.028870 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-6e88fd0e-875d-47f5-90f6-653c4e3c5c68 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:02.029358 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-6e88fd0e-875d-47f5-90f6-653c4e3c5c68 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:02.030055 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-6e88fd0e-875d-47f5-90f6-653c4e3c5c68 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:02.030496 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-6e88fd0e-875d-47f5-90f6-653c4e3c5c68 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:02.030913 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-6e88fd0e-875d-47f5-90f6-653c4e3c5c68 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:02.153174 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-7ae5a3dc-88ca-48df-a785-3cba56d46aac tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:02.153891 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-7ae5a3dc-88ca-48df-a785-3cba56d46aac tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: 1eaf7cc8-63d3-40c6-b5f5-e4e978ddfe17] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:02.160543 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-7ae5a3dc-88ca-48df-a785-3cba56d46aac tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:02.161284 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-7ae5a3dc-88ca-48df-a785-3cba56d46aac tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:02.161717 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-7ae5a3dc-88ca-48df-a785-3cba56d46aac tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:02.162426 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-7ae5a3dc-88ca-48df-a785-3cba56d46aac tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:02.164547 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-7ae5a3dc-88ca-48df-a785-3cba56d46aac tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:02.164547 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-7ae5a3dc-88ca-48df-a785-3cba56d46aac tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:02.191603 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-6e88fd0e-875d-47f5-90f6-653c4e3c5c68 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c1b55b5c04ba380ed8ffdaa462bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa6bd99403b4421acb8bd714c9450c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:02.201475 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-6e88fd0e-875d-47f5-90f6-653c4e3c5c68 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] 10.222.0.52 "GET /compute/v2.1/servers/0e97301c-3a01-452d-b54a-6bf66c4793d9" status: 200 len: 1314 microversion: 2.1 time: 0.184346 Oct 28 09:48:02.201970 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 114/224] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:48:02 2022] GET /compute/v2.1/servers/0e97301c-3a01-452d-b54a-6bf66c4793d9 => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:48:02.306784 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-7ae5a3dc-88ca-48df-a785-3cba56d46aac tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe6eb38e8df492daaef5755ddea7773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234f69f21d7a456a9ab6a86c4ac2ede2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:02.314815 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-7ae5a3dc-88ca-48df-a785-3cba56d46aac tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] 10.222.0.52 "GET /compute/v2.1/servers/1eaf7cc8-63d3-40c6-b5f5-e4e978ddfe17" status: 200 len: 1522 microversion: 2.1 time: 0.167825 Oct 28 09:48:02.315539 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 111/225] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:48:02 2022] GET /compute/v2.1/servers/1eaf7cc8-63d3-40c6-b5f5-e4e978ddfe17 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:48:03.224643 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-39ca5d68-9d97-40ac-ac22-b0a07c62e6c1 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:03.225808 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-39ca5d68-9d97-40ac-ac22-b0a07c62e6c1 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] [instance: 0e97301c-3a01-452d-b54a-6bf66c4793d9] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:03.233359 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-39ca5d68-9d97-40ac-ac22-b0a07c62e6c1 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:03.233848 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-39ca5d68-9d97-40ac-ac22-b0a07c62e6c1 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:03.234278 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-39ca5d68-9d97-40ac-ac22-b0a07c62e6c1 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:03.234972 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-39ca5d68-9d97-40ac-ac22-b0a07c62e6c1 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:03.235457 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-39ca5d68-9d97-40ac-ac22-b0a07c62e6c1 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:03.235903 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-39ca5d68-9d97-40ac-ac22-b0a07c62e6c1 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:03.340257 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-937dea04-5560-43e8-a85b-d47daba9807d tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:03.340910 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-937dea04-5560-43e8-a85b-d47daba9807d tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: 1eaf7cc8-63d3-40c6-b5f5-e4e978ddfe17] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:03.347594 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-937dea04-5560-43e8-a85b-d47daba9807d tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:03.348274 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-937dea04-5560-43e8-a85b-d47daba9807d tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:03.348764 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-937dea04-5560-43e8-a85b-d47daba9807d tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:03.349638 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-937dea04-5560-43e8-a85b-d47daba9807d tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:03.350385 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-937dea04-5560-43e8-a85b-d47daba9807d tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:03.350958 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-937dea04-5560-43e8-a85b-d47daba9807d tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:03.377902 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-39ca5d68-9d97-40ac-ac22-b0a07c62e6c1 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c1b55b5c04ba380ed8ffdaa462bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa6bd99403b4421acb8bd714c9450c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:03.388279 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-39ca5d68-9d97-40ac-ac22-b0a07c62e6c1 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] 10.222.0.52 "GET /compute/v2.1/servers/0e97301c-3a01-452d-b54a-6bf66c4793d9" status: 200 len: 1314 microversion: 2.1 time: 0.167555 Oct 28 09:48:03.395496 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 115/226] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:48:03 2022] GET /compute/v2.1/servers/0e97301c-3a01-452d-b54a-6bf66c4793d9 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:48:03.502972 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-937dea04-5560-43e8-a85b-d47daba9807d tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe6eb38e8df492daaef5755ddea7773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234f69f21d7a456a9ab6a86c4ac2ede2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:03.511920 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-937dea04-5560-43e8-a85b-d47daba9807d tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] 10.222.0.52 "GET /compute/v2.1/servers/1eaf7cc8-63d3-40c6-b5f5-e4e978ddfe17" status: 200 len: 1522 microversion: 2.1 time: 0.176005 Oct 28 09:48:03.512528 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 112/227] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:48:03 2022] GET /compute/v2.1/servers/1eaf7cc8-63d3-40c6-b5f5-e4e978ddfe17 => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:48:04.411836 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-ef72b29a-78d3-4181-bc1a-deab12d9a73a tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:04.412454 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-ef72b29a-78d3-4181-bc1a-deab12d9a73a tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] [instance: 0e97301c-3a01-452d-b54a-6bf66c4793d9] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:04.415538 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG dbcounter [-] [127033] Writing DB stats nova_api:SELECT=40 {{(pid=127033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:48:04.421364 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-ef72b29a-78d3-4181-bc1a-deab12d9a73a tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:04.422158 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-ef72b29a-78d3-4181-bc1a-deab12d9a73a tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:04.422334 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-ef72b29a-78d3-4181-bc1a-deab12d9a73a tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:04.423075 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-ef72b29a-78d3-4181-bc1a-deab12d9a73a tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:04.423535 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-ef72b29a-78d3-4181-bc1a-deab12d9a73a tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:04.423995 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-ef72b29a-78d3-4181-bc1a-deab12d9a73a tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:04.537985 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-7e561722-303d-456b-81aa-66870dce7fab tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:04.538578 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-7e561722-303d-456b-81aa-66870dce7fab tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: 1eaf7cc8-63d3-40c6-b5f5-e4e978ddfe17] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:04.540574 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG dbcounter [-] [127032] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=127032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:48:04.546806 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-7e561722-303d-456b-81aa-66870dce7fab tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:04.547332 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-7e561722-303d-456b-81aa-66870dce7fab tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:04.547908 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-7e561722-303d-456b-81aa-66870dce7fab tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:04.548471 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-7e561722-303d-456b-81aa-66870dce7fab tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:04.548981 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-7e561722-303d-456b-81aa-66870dce7fab tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:04.549403 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-7e561722-303d-456b-81aa-66870dce7fab tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:04.570029 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-ef72b29a-78d3-4181-bc1a-deab12d9a73a tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c1b55b5c04ba380ed8ffdaa462bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa6bd99403b4421acb8bd714c9450c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:04.578544 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-ef72b29a-78d3-4181-bc1a-deab12d9a73a tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] 10.222.0.52 "GET /compute/v2.1/servers/0e97301c-3a01-452d-b54a-6bf66c4793d9" status: 200 len: 1314 microversion: 2.1 time: 0.170751 Oct 28 09:48:04.579309 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 116/228] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:48:04 2022] GET /compute/v2.1/servers/0e97301c-3a01-452d-b54a-6bf66c4793d9 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:48:04.692830 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-7e561722-303d-456b-81aa-66870dce7fab tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe6eb38e8df492daaef5755ddea7773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234f69f21d7a456a9ab6a86c4ac2ede2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:04.701485 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-7e561722-303d-456b-81aa-66870dce7fab tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] 10.222.0.52 "GET /compute/v2.1/servers/1eaf7cc8-63d3-40c6-b5f5-e4e978ddfe17" status: 200 len: 1522 microversion: 2.1 time: 0.167454 Oct 28 09:48:04.702069 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 113/229] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:48:04 2022] GET /compute/v2.1/servers/1eaf7cc8-63d3-40c6-b5f5-e4e978ddfe17 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:48:05.601109 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-39814984-6176-4ffd-a7f8-077029f822d9 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:05.601736 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-39814984-6176-4ffd-a7f8-077029f822d9 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] [instance: 0e97301c-3a01-452d-b54a-6bf66c4793d9] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:05.608396 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-39814984-6176-4ffd-a7f8-077029f822d9 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:05.608873 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-39814984-6176-4ffd-a7f8-077029f822d9 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:05.609297 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-39814984-6176-4ffd-a7f8-077029f822d9 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:05.609973 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-39814984-6176-4ffd-a7f8-077029f822d9 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:05.610424 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-39814984-6176-4ffd-a7f8-077029f822d9 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:05.610839 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-39814984-6176-4ffd-a7f8-077029f822d9 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:05.724598 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-2db684c0-edc7-4563-aa1c-1c65c8a1de73 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:05.725322 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-2db684c0-edc7-4563-aa1c-1c65c8a1de73 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: 1eaf7cc8-63d3-40c6-b5f5-e4e978ddfe17] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:05.731676 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-2db684c0-edc7-4563-aa1c-1c65c8a1de73 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:05.732195 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-2db684c0-edc7-4563-aa1c-1c65c8a1de73 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:05.732630 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-2db684c0-edc7-4563-aa1c-1c65c8a1de73 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:05.733340 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-2db684c0-edc7-4563-aa1c-1c65c8a1de73 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:05.733792 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-2db684c0-edc7-4563-aa1c-1c65c8a1de73 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:05.734217 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-2db684c0-edc7-4563-aa1c-1c65c8a1de73 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:05.738275 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-39814984-6176-4ffd-a7f8-077029f822d9 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c1b55b5c04ba380ed8ffdaa462bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa6bd99403b4421acb8bd714c9450c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:05.746642 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-39814984-6176-4ffd-a7f8-077029f822d9 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] 10.222.0.52 "GET /compute/v2.1/servers/0e97301c-3a01-452d-b54a-6bf66c4793d9" status: 200 len: 1314 microversion: 2.1 time: 0.149323 Oct 28 09:48:05.747235 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 117/230] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:48:05 2022] GET /compute/v2.1/servers/0e97301c-3a01-452d-b54a-6bf66c4793d9 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:48:05.863734 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-2db684c0-edc7-4563-aa1c-1c65c8a1de73 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe6eb38e8df492daaef5755ddea7773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234f69f21d7a456a9ab6a86c4ac2ede2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:05.871855 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-2db684c0-edc7-4563-aa1c-1c65c8a1de73 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] 10.222.0.52 "GET /compute/v2.1/servers/1eaf7cc8-63d3-40c6-b5f5-e4e978ddfe17" status: 200 len: 1522 microversion: 2.1 time: 0.151012 Oct 28 09:48:05.872517 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 114/231] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:48:05 2022] GET /compute/v2.1/servers/1eaf7cc8-63d3-40c6-b5f5-e4e978ddfe17 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:48:05.941183 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-ed0cea56-ef15-44c6-a903-8d37eb0c9995 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1548885096", "imageRef": "6e314146-a2ed-4f8b-afdd-4f7ed1184d20", "flavorRef": "452"}} {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:48:06.002976 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.network.neutron [None req-ed0cea56-ef15-44c6-a903-8d37eb0c9995 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] validate_networks() for None {{(pid=127033) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 09:48:06.317579 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.virt.hardware [None req-ed0cea56-ef15-44c6-a903-8d37eb0c9995 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Flavor limits 0:0:0 {{(pid=127033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 09:48:06.318002 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.virt.hardware [None req-ed0cea56-ef15-44c6-a903-8d37eb0c9995 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Image limits 0:0:0 {{(pid=127033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 09:48:06.318475 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.virt.hardware [None req-ed0cea56-ef15-44c6-a903-8d37eb0c9995 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Flavor pref 0:0:0 {{(pid=127033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 09:48:06.319443 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.virt.hardware [None req-ed0cea56-ef15-44c6-a903-8d37eb0c9995 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Image pref 0:0:0 {{(pid=127033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 09:48:06.319894 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.virt.hardware [None req-ed0cea56-ef15-44c6-a903-8d37eb0c9995 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 09:48:06.329813 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-ed0cea56-ef15-44c6-a903-8d37eb0c9995 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:06.330306 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-ed0cea56-ef15-44c6-a903-8d37eb0c9995 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:06.330744 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-ed0cea56-ef15-44c6-a903-8d37eb0c9995 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:06.331478 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-ed0cea56-ef15-44c6-a903-8d37eb0c9995 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:06.331970 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-ed0cea56-ef15-44c6-a903-8d37eb0c9995 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:06.332405 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-ed0cea56-ef15-44c6-a903-8d37eb0c9995 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:06.352342 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.quota [None req-ed0cea56-ef15-44c6-a903-8d37eb0c9995 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Getting quotas for project d89c15d74a584be3b5e44f74ed50eea3. Resources: {'cores', 'ram', 'instances'} {{(pid=127033) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 09:48:06.357303 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.quota [None req-ed0cea56-ef15-44c6-a903-8d37eb0c9995 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Getting quotas for user c05718633def4ad6822728767580b810 and project d89c15d74a584be3b5e44f74ed50eea3. Resources: {'cores', 'ram', 'instances'} {{(pid=127033) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 09:48:06.371327 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-ed0cea56-ef15-44c6-a903-8d37eb0c9995 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Going to run 1 instances... {{(pid=127033) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 09:48:06.373667 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-ed0cea56-ef15-44c6-a903-8d37eb0c9995 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] [instance: 7ab20f71-d81e-4b6a-90f0-e4b0873c0469] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e314146-a2ed-4f8b-afdd-4f7ed1184d20',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127033) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 09:48:06.423696 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-ed0cea56-ef15-44c6-a903-8d37eb0c9995 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.486279 Oct 28 09:48:06.424686 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 118/232] 10.222.0.52 () {60 vars in 1147 bytes} [Fri Oct 28 09:48:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 488 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 28 09:48:06.436159 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-a2bfd590-b57f-4b6d-8960-c27fe2916fbf tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:06.436770 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-a2bfd590-b57f-4b6d-8960-c27fe2916fbf tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] [instance: 7ab20f71-d81e-4b6a-90f0-e4b0873c0469] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:06.514958 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-a2bfd590-b57f-4b6d-8960-c27fe2916fbf tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05718633def4ad6822728767580b810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89c15d74a584be3b5e44f74ed50eea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:06.523717 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-a2bfd590-b57f-4b6d-8960-c27fe2916fbf tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] 10.222.0.52 "GET /compute/v2.1/servers/7ab20f71-d81e-4b6a-90f0-e4b0873c0469" status: 200 len: 1215 microversion: 2.1 time: 0.091450 Oct 28 09:48:06.524650 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 115/233] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:48:06 2022] GET /compute/v2.1/servers/7ab20f71-d81e-4b6a-90f0-e4b0873c0469 => generated 1215 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:48:06.772382 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-f6880db6-e300-44f8-b37b-9971a8690703 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:06.773192 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-f6880db6-e300-44f8-b37b-9971a8690703 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] [instance: 0e97301c-3a01-452d-b54a-6bf66c4793d9] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:06.781406 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-f6880db6-e300-44f8-b37b-9971a8690703 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:06.782256 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-f6880db6-e300-44f8-b37b-9971a8690703 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:06.782898 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-f6880db6-e300-44f8-b37b-9971a8690703 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:06.784048 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-f6880db6-e300-44f8-b37b-9971a8690703 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:06.784695 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-f6880db6-e300-44f8-b37b-9971a8690703 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:06.785302 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-f6880db6-e300-44f8-b37b-9971a8690703 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:06.898367 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-73d7aeea-d3c2-4a26-8d58-a7538e97ee56 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:06.899083 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-73d7aeea-d3c2-4a26-8d58-a7538e97ee56 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: 1eaf7cc8-63d3-40c6-b5f5-e4e978ddfe17] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:06.905980 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-73d7aeea-d3c2-4a26-8d58-a7538e97ee56 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:06.906483 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-73d7aeea-d3c2-4a26-8d58-a7538e97ee56 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:06.906924 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-73d7aeea-d3c2-4a26-8d58-a7538e97ee56 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:06.907650 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-73d7aeea-d3c2-4a26-8d58-a7538e97ee56 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:06.908160 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-73d7aeea-d3c2-4a26-8d58-a7538e97ee56 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:06.908589 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-73d7aeea-d3c2-4a26-8d58-a7538e97ee56 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:06.948893 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-f6880db6-e300-44f8-b37b-9971a8690703 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c1b55b5c04ba380ed8ffdaa462bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa6bd99403b4421acb8bd714c9450c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:06.960817 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG dbcounter [-] [127033] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:48:06.964065 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-f6880db6-e300-44f8-b37b-9971a8690703 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] 10.222.0.52 "GET /compute/v2.1/servers/0e97301c-3a01-452d-b54a-6bf66c4793d9" status: 200 len: 1314 microversion: 2.1 time: 0.196562 Oct 28 09:48:06.964832 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 119/234] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:48:06 2022] GET /compute/v2.1/servers/0e97301c-3a01-452d-b54a-6bf66c4793d9 => generated 1314 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:48:07.048334 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-73d7aeea-d3c2-4a26-8d58-a7538e97ee56 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe6eb38e8df492daaef5755ddea7773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234f69f21d7a456a9ab6a86c4ac2ede2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:07.056413 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-73d7aeea-d3c2-4a26-8d58-a7538e97ee56 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] 10.222.0.52 "GET /compute/v2.1/servers/1eaf7cc8-63d3-40c6-b5f5-e4e978ddfe17" status: 200 len: 1522 microversion: 2.1 time: 0.163263 Oct 28 09:48:07.056987 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 116/235] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:48:06 2022] GET /compute/v2.1/servers/1eaf7cc8-63d3-40c6-b5f5-e4e978ddfe17 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:48:07.547229 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-99e0d899-36e6-4b76-85fb-485d6fbe1b8b tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:07.547872 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-99e0d899-36e6-4b76-85fb-485d6fbe1b8b tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] [instance: 7ab20f71-d81e-4b6a-90f0-e4b0873c0469] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:07.555670 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-99e0d899-36e6-4b76-85fb-485d6fbe1b8b tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:07.556285 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-99e0d899-36e6-4b76-85fb-485d6fbe1b8b tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:07.556716 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-99e0d899-36e6-4b76-85fb-485d6fbe1b8b tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:07.557415 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-99e0d899-36e6-4b76-85fb-485d6fbe1b8b tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:07.557854 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-99e0d899-36e6-4b76-85fb-485d6fbe1b8b tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:07.558271 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-99e0d899-36e6-4b76-85fb-485d6fbe1b8b tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:07.622812 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-99e0d899-36e6-4b76-85fb-485d6fbe1b8b tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05718633def4ad6822728767580b810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89c15d74a584be3b5e44f74ed50eea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:07.630530 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-99e0d899-36e6-4b76-85fb-485d6fbe1b8b tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] 10.222.0.52 "GET /compute/v2.1/servers/7ab20f71-d81e-4b6a-90f0-e4b0873c0469" status: 200 len: 1219 microversion: 2.1 time: 0.087893 Oct 28 09:48:07.631093 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 120/236] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:48:07 2022] GET /compute/v2.1/servers/7ab20f71-d81e-4b6a-90f0-e4b0873c0469 => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:48:07.989271 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-b0da39b7-b9b2-48d9-8b6b-60c060c33510 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:07.990594 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-b0da39b7-b9b2-48d9-8b6b-60c060c33510 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] [instance: 0e97301c-3a01-452d-b54a-6bf66c4793d9] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:07.998091 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-b0da39b7-b9b2-48d9-8b6b-60c060c33510 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:07.998857 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-b0da39b7-b9b2-48d9-8b6b-60c060c33510 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:07.999518 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-b0da39b7-b9b2-48d9-8b6b-60c060c33510 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:08.000449 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-b0da39b7-b9b2-48d9-8b6b-60c060c33510 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:08.001093 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-b0da39b7-b9b2-48d9-8b6b-60c060c33510 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:08.001702 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-b0da39b7-b9b2-48d9-8b6b-60c060c33510 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:08.084252 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-94e4ac74-ff34-4ef8-83f6-18847f057fbc tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:08.085244 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-94e4ac74-ff34-4ef8-83f6-18847f057fbc tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: 1eaf7cc8-63d3-40c6-b5f5-e4e978ddfe17] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:08.093905 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-94e4ac74-ff34-4ef8-83f6-18847f057fbc tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:08.094402 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-94e4ac74-ff34-4ef8-83f6-18847f057fbc tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:08.094835 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-94e4ac74-ff34-4ef8-83f6-18847f057fbc tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:08.095587 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-94e4ac74-ff34-4ef8-83f6-18847f057fbc tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:08.096029 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-94e4ac74-ff34-4ef8-83f6-18847f057fbc tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:08.096452 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-94e4ac74-ff34-4ef8-83f6-18847f057fbc tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:08.227223 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-b0da39b7-b9b2-48d9-8b6b-60c060c33510 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c1b55b5c04ba380ed8ffdaa462bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa6bd99403b4421acb8bd714c9450c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:08.237924 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-b0da39b7-b9b2-48d9-8b6b-60c060c33510 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] 10.222.0.52 "GET /compute/v2.1/servers/0e97301c-3a01-452d-b54a-6bf66c4793d9" status: 200 len: 1314 microversion: 2.1 time: 0.253143 Oct 28 09:48:08.240155 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 117/237] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:48:07 2022] GET /compute/v2.1/servers/0e97301c-3a01-452d-b54a-6bf66c4793d9 => generated 1314 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:48:08.296167 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-94e4ac74-ff34-4ef8-83f6-18847f057fbc tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe6eb38e8df492daaef5755ddea7773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234f69f21d7a456a9ab6a86c4ac2ede2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:08.312182 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-94e4ac74-ff34-4ef8-83f6-18847f057fbc tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] 10.222.0.52 "GET /compute/v2.1/servers/1eaf7cc8-63d3-40c6-b5f5-e4e978ddfe17" status: 200 len: 1522 microversion: 2.1 time: 0.233697 Oct 28 09:48:08.313061 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 121/238] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:48:08 2022] GET /compute/v2.1/servers/1eaf7cc8-63d3-40c6-b5f5-e4e978ddfe17 => generated 1522 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:48:08.376966 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-1013721e-a025-486c-bc6b-946dd5af994a tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4adfb3fc-0236-45dc-a5b9-1e3c07a57b4b", "device": "/dev/sdb"}} {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:48:08.379965 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-1013721e-a025-486c-bc6b-946dd5af994a tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] [instance: 86989378-da9a-4b30-98a7-1ce557ef51cb] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:08.386047 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-1013721e-a025-486c-bc6b-946dd5af994a tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:08.386531 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-1013721e-a025-486c-bc6b-946dd5af994a tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:08.386963 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-1013721e-a025-486c-bc6b-946dd5af994a tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:08.387657 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-1013721e-a025-486c-bc6b-946dd5af994a tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:08.388160 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-1013721e-a025-486c-bc6b-946dd5af994a tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:08.388586 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-1013721e-a025-486c-bc6b-946dd5af994a tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:08.409487 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG dbcounter [-] [127032] Writing DB stats nova_cell0:SELECT=2 {{(pid=127032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:48:08.654956 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-0a3a87cd-6375-4ce8-87e8-42a3ba86cef5 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:08.655509 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-0a3a87cd-6375-4ce8-87e8-42a3ba86cef5 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] [instance: 7ab20f71-d81e-4b6a-90f0-e4b0873c0469] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:08.661743 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-0a3a87cd-6375-4ce8-87e8-42a3ba86cef5 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:08.662241 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-0a3a87cd-6375-4ce8-87e8-42a3ba86cef5 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:08.662676 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-0a3a87cd-6375-4ce8-87e8-42a3ba86cef5 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:08.663376 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-0a3a87cd-6375-4ce8-87e8-42a3ba86cef5 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:08.663860 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-0a3a87cd-6375-4ce8-87e8-42a3ba86cef5 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:08.664286 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-0a3a87cd-6375-4ce8-87e8-42a3ba86cef5 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:08.728407 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-0a3a87cd-6375-4ce8-87e8-42a3ba86cef5 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05718633def4ad6822728767580b810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89c15d74a584be3b5e44f74ed50eea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:08.736703 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-0a3a87cd-6375-4ce8-87e8-42a3ba86cef5 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] 10.222.0.52 "GET /compute/v2.1/servers/7ab20f71-d81e-4b6a-90f0-e4b0873c0469" status: 200 len: 1267 microversion: 2.1 time: 0.085730 Oct 28 09:48:08.737755 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 122/239] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:48:08 2022] GET /compute/v2.1/servers/7ab20f71-d81e-4b6a-90f0-e4b0873c0469 => generated 1267 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:48:09.262099 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-fb1f32d3-9fc5-4eda-89f9-792402ff1cb6 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:09.262712 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-fb1f32d3-9fc5-4eda-89f9-792402ff1cb6 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] [instance: 0e97301c-3a01-452d-b54a-6bf66c4793d9] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:09.269119 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-fb1f32d3-9fc5-4eda-89f9-792402ff1cb6 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:09.269603 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-fb1f32d3-9fc5-4eda-89f9-792402ff1cb6 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:09.270031 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-fb1f32d3-9fc5-4eda-89f9-792402ff1cb6 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:09.270723 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-fb1f32d3-9fc5-4eda-89f9-792402ff1cb6 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:09.271173 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-fb1f32d3-9fc5-4eda-89f9-792402ff1cb6 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:09.271618 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-fb1f32d3-9fc5-4eda-89f9-792402ff1cb6 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:09.403853 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-fb1f32d3-9fc5-4eda-89f9-792402ff1cb6 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c1b55b5c04ba380ed8ffdaa462bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa6bd99403b4421acb8bd714c9450c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:09.411366 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-fb1f32d3-9fc5-4eda-89f9-792402ff1cb6 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] 10.222.0.52 "GET /compute/v2.1/servers/0e97301c-3a01-452d-b54a-6bf66c4793d9" status: 200 len: 1314 microversion: 2.1 time: 0.153259 Oct 28 09:48:09.411978 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 123/240] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:48:09 2022] GET /compute/v2.1/servers/0e97301c-3a01-452d-b54a-6bf66c4793d9 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:48:09.416827 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-da383eb6-b4ae-4e23-b821-84f9a65532b6 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:09.417452 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-da383eb6-b4ae-4e23-b821-84f9a65532b6 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: 1eaf7cc8-63d3-40c6-b5f5-e4e978ddfe17] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:09.422960 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-da383eb6-b4ae-4e23-b821-84f9a65532b6 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:09.423446 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-da383eb6-b4ae-4e23-b821-84f9a65532b6 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:09.423911 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-da383eb6-b4ae-4e23-b821-84f9a65532b6 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:09.424603 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-da383eb6-b4ae-4e23-b821-84f9a65532b6 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:09.425057 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-da383eb6-b4ae-4e23-b821-84f9a65532b6 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:09.425474 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-da383eb6-b4ae-4e23-b821-84f9a65532b6 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:09.559527 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-da383eb6-b4ae-4e23-b821-84f9a65532b6 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe6eb38e8df492daaef5755ddea7773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234f69f21d7a456a9ab6a86c4ac2ede2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:09.568386 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-da383eb6-b4ae-4e23-b821-84f9a65532b6 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] 10.222.0.52 "GET /compute/v2.1/servers/1eaf7cc8-63d3-40c6-b5f5-e4e978ddfe17" status: 200 len: 1522 microversion: 2.1 time: 0.155418 Oct 28 09:48:09.568965 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 124/241] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:48:09 2022] GET /compute/v2.1/servers/1eaf7cc8-63d3-40c6-b5f5-e4e978ddfe17 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:48:09.760580 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-160b437a-758a-44ba-8785-269156459b67 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:09.761186 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-160b437a-758a-44ba-8785-269156459b67 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] [instance: 7ab20f71-d81e-4b6a-90f0-e4b0873c0469] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:09.767047 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-160b437a-758a-44ba-8785-269156459b67 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:09.767553 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-160b437a-758a-44ba-8785-269156459b67 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:09.768022 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-160b437a-758a-44ba-8785-269156459b67 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:09.768706 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-160b437a-758a-44ba-8785-269156459b67 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:09.769159 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-160b437a-758a-44ba-8785-269156459b67 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:09.769578 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-160b437a-758a-44ba-8785-269156459b67 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:09.832447 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-160b437a-758a-44ba-8785-269156459b67 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05718633def4ad6822728767580b810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89c15d74a584be3b5e44f74ed50eea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:09.840739 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-160b437a-758a-44ba-8785-269156459b67 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] 10.222.0.52 "GET /compute/v2.1/servers/7ab20f71-d81e-4b6a-90f0-e4b0873c0469" status: 200 len: 1275 microversion: 2.1 time: 0.084313 Oct 28 09:48:09.841315 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 125/242] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:48:09 2022] GET /compute/v2.1/servers/7ab20f71-d81e-4b6a-90f0-e4b0873c0469 => generated 1275 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:48:10.258968 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [req-791d3408-c3f8-455a-85e0-a6435a79e863 req-e6699234-f40f-4c28-bddf-62ab3a478b17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e97301c-3a01-452d-b54a-6bf66c4793d9", "name": "network-vif-plugged", "status": "completed", "tag": "bbde4e9b-6519-4264-9bd3-d11d2c951c54"}]} {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:48:10.268985 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-791d3408-c3f8-455a-85e0-a6435a79e863 req-e6699234-f40f-4c28-bddf-62ab3a478b17 service nova] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:10.269536 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-791d3408-c3f8-455a-85e0-a6435a79e863 req-e6699234-f40f-4c28-bddf-62ab3a478b17 service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:10.269889 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-791d3408-c3f8-455a-85e0-a6435a79e863 req-e6699234-f40f-4c28-bddf-62ab3a478b17 service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:10.281786 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.compute.server_external_events [req-791d3408-c3f8-455a-85e0-a6435a79e863 req-e6699234-f40f-4c28-bddf-62ab3a478b17 service nova] Creating event network-vif-plugged:bbde4e9b-6519-4264-9bd3-d11d2c951c54 for instance 0e97301c-3a01-452d-b54a-6bf66c4793d9 on hv-cinder-zed-3 Oct 28 09:48:10.286904 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [req-791d3408-c3f8-455a-85e0-a6435a79e863 req-e6699234-f40f-4c28-bddf-62ab3a478b17 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032287 Oct 28 09:48:10.287593 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 126/243] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Oct 28 09:48:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 09:48:10.435855 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-6472c0ce-3ded-4b2d-a22c-a8d3021f5780 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:10.436575 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-6472c0ce-3ded-4b2d-a22c-a8d3021f5780 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] [instance: 0e97301c-3a01-452d-b54a-6bf66c4793d9] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:10.443311 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-6472c0ce-3ded-4b2d-a22c-a8d3021f5780 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:10.443843 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-6472c0ce-3ded-4b2d-a22c-a8d3021f5780 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:10.444289 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-6472c0ce-3ded-4b2d-a22c-a8d3021f5780 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:10.445615 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-6472c0ce-3ded-4b2d-a22c-a8d3021f5780 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:10.446072 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-6472c0ce-3ded-4b2d-a22c-a8d3021f5780 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:10.446496 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-6472c0ce-3ded-4b2d-a22c-a8d3021f5780 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:10.586185 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-6472c0ce-3ded-4b2d-a22c-a8d3021f5780 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c1b55b5c04ba380ed8ffdaa462bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa6bd99403b4421acb8bd714c9450c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:10.594184 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-6472c0ce-3ded-4b2d-a22c-a8d3021f5780 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] 10.222.0.52 "GET /compute/v2.1/servers/0e97301c-3a01-452d-b54a-6bf66c4793d9" status: 200 len: 1314 microversion: 2.1 time: 0.162579 Oct 28 09:48:10.594761 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 127/244] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:48:10 2022] GET /compute/v2.1/servers/0e97301c-3a01-452d-b54a-6bf66c4793d9 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:48:10.600775 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-84aa07eb-e377-41dd-b794-f2cd7855b498 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:10.600775 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-84aa07eb-e377-41dd-b794-f2cd7855b498 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: 1eaf7cc8-63d3-40c6-b5f5-e4e978ddfe17] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:10.606895 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-84aa07eb-e377-41dd-b794-f2cd7855b498 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:10.607390 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-84aa07eb-e377-41dd-b794-f2cd7855b498 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:10.607855 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-84aa07eb-e377-41dd-b794-f2cd7855b498 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:10.608565 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-84aa07eb-e377-41dd-b794-f2cd7855b498 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:10.609029 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-84aa07eb-e377-41dd-b794-f2cd7855b498 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:10.609454 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-84aa07eb-e377-41dd-b794-f2cd7855b498 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:10.777686 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-84aa07eb-e377-41dd-b794-f2cd7855b498 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe6eb38e8df492daaef5755ddea7773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234f69f21d7a456a9ab6a86c4ac2ede2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:10.793246 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-84aa07eb-e377-41dd-b794-f2cd7855b498 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] 10.222.0.52 "GET /compute/v2.1/servers/1eaf7cc8-63d3-40c6-b5f5-e4e978ddfe17" status: 200 len: 1522 microversion: 2.1 time: 0.197285 Oct 28 09:48:10.794112 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 128/245] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:48:10 2022] GET /compute/v2.1/servers/1eaf7cc8-63d3-40c6-b5f5-e4e978ddfe17 => generated 1522 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:48:10.864566 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-db4c0125-105f-4782-8ab2-0c1a75b95705 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:10.865185 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-db4c0125-105f-4782-8ab2-0c1a75b95705 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] [instance: 7ab20f71-d81e-4b6a-90f0-e4b0873c0469] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:10.873837 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-db4c0125-105f-4782-8ab2-0c1a75b95705 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:10.874397 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-db4c0125-105f-4782-8ab2-0c1a75b95705 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:10.875052 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-db4c0125-105f-4782-8ab2-0c1a75b95705 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:10.875881 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-db4c0125-105f-4782-8ab2-0c1a75b95705 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:10.876350 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-db4c0125-105f-4782-8ab2-0c1a75b95705 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:10.877338 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-db4c0125-105f-4782-8ab2-0c1a75b95705 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:10.963365 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-1013721e-a025-486c-bc6b-946dd5af994a tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] 10.222.0.52 "POST /compute/v2.1/servers/86989378-da9a-4b30-98a7-1ce557ef51cb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.590162 Oct 28 09:48:10.964497 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 118/246] 10.222.0.52 () {60 vars in 1323 bytes} [Fri Oct 28 09:48:08 2022] POST /compute/v2.1/servers/86989378-da9a-4b30-98a7-1ce557ef51cb/os-volume_attachments => generated 194 bytes in 2592 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:48:10.989359 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-db4c0125-105f-4782-8ab2-0c1a75b95705 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05718633def4ad6822728767580b810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89c15d74a584be3b5e44f74ed50eea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:10.998240 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-db4c0125-105f-4782-8ab2-0c1a75b95705 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] 10.222.0.52 "GET /compute/v2.1/servers/7ab20f71-d81e-4b6a-90f0-e4b0873c0469" status: 200 len: 1275 microversion: 2.1 time: 0.137945 Oct 28 09:48:10.998839 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 129/247] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:48:10 2022] GET /compute/v2.1/servers/7ab20f71-d81e-4b6a-90f0-e4b0873c0469 => generated 1275 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:48:11.619059 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-085f7147-87c5-4e22-816e-d09c5ec1c74a tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:11.620031 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-085f7147-87c5-4e22-816e-d09c5ec1c74a tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] [instance: 0e97301c-3a01-452d-b54a-6bf66c4793d9] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:11.626991 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-085f7147-87c5-4e22-816e-d09c5ec1c74a tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:11.627620 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-085f7147-87c5-4e22-816e-d09c5ec1c74a tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:11.628102 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-085f7147-87c5-4e22-816e-d09c5ec1c74a tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:11.628811 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-085f7147-87c5-4e22-816e-d09c5ec1c74a tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:11.629295 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-085f7147-87c5-4e22-816e-d09c5ec1c74a tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:11.629724 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-085f7147-87c5-4e22-816e-d09c5ec1c74a tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:11.764353 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-085f7147-87c5-4e22-816e-d09c5ec1c74a tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c1b55b5c04ba380ed8ffdaa462bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa6bd99403b4421acb8bd714c9450c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:11.772246 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-085f7147-87c5-4e22-816e-d09c5ec1c74a tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] 10.222.0.52 "GET /compute/v2.1/servers/0e97301c-3a01-452d-b54a-6bf66c4793d9" status: 200 len: 1314 microversion: 2.1 time: 0.158298 Oct 28 09:48:11.773007 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 119/248] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:48:11 2022] GET /compute/v2.1/servers/0e97301c-3a01-452d-b54a-6bf66c4793d9 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:48:11.817108 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-6498811c-6892-4d43-842b-4730d963270f tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:11.817706 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-6498811c-6892-4d43-842b-4730d963270f tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: 1eaf7cc8-63d3-40c6-b5f5-e4e978ddfe17] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:11.825506 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-6498811c-6892-4d43-842b-4730d963270f tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:11.825995 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-6498811c-6892-4d43-842b-4730d963270f tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:11.826419 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-6498811c-6892-4d43-842b-4730d963270f tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:11.827110 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-6498811c-6892-4d43-842b-4730d963270f tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:11.827574 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-6498811c-6892-4d43-842b-4730d963270f tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:11.828140 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-6498811c-6892-4d43-842b-4730d963270f tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:11.973151 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-6498811c-6892-4d43-842b-4730d963270f tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe6eb38e8df492daaef5755ddea7773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234f69f21d7a456a9ab6a86c4ac2ede2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:11.982355 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-6498811c-6892-4d43-842b-4730d963270f tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] 10.222.0.52 "GET /compute/v2.1/servers/1eaf7cc8-63d3-40c6-b5f5-e4e978ddfe17" status: 200 len: 1522 microversion: 2.1 time: 0.169157 Oct 28 09:48:11.982983 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 130/249] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:48:11 2022] GET /compute/v2.1/servers/1eaf7cc8-63d3-40c6-b5f5-e4e978ddfe17 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:48:12.021320 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-3bc08419-6bfa-40e2-aff0-a4739a2dd3d1 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:12.021990 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-3bc08419-6bfa-40e2-aff0-a4739a2dd3d1 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] [instance: 7ab20f71-d81e-4b6a-90f0-e4b0873c0469] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:12.029034 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-3bc08419-6bfa-40e2-aff0-a4739a2dd3d1 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:12.029517 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-3bc08419-6bfa-40e2-aff0-a4739a2dd3d1 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:12.030271 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-3bc08419-6bfa-40e2-aff0-a4739a2dd3d1 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:12.031041 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-3bc08419-6bfa-40e2-aff0-a4739a2dd3d1 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:12.031505 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-3bc08419-6bfa-40e2-aff0-a4739a2dd3d1 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:12.031993 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-3bc08419-6bfa-40e2-aff0-a4739a2dd3d1 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:12.054782 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG dbcounter [-] [127032] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:48:12.199772 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-3bc08419-6bfa-40e2-aff0-a4739a2dd3d1 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05718633def4ad6822728767580b810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89c15d74a584be3b5e44f74ed50eea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:12.207679 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-3bc08419-6bfa-40e2-aff0-a4739a2dd3d1 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] 10.222.0.52 "GET /compute/v2.1/servers/7ab20f71-d81e-4b6a-90f0-e4b0873c0469" status: 200 len: 1315 microversion: 2.1 time: 0.190238 Oct 28 09:48:12.208305 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 120/250] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:48:12 2022] GET /compute/v2.1/servers/7ab20f71-d81e-4b6a-90f0-e4b0873c0469 => generated 1315 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:48:12.794951 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-7560c03b-4ce5-4d64-96d6-f8aa9eb0268f tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:12.795558 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-7560c03b-4ce5-4d64-96d6-f8aa9eb0268f tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] [instance: 0e97301c-3a01-452d-b54a-6bf66c4793d9] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:12.801528 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-7560c03b-4ce5-4d64-96d6-f8aa9eb0268f tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:12.802015 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-7560c03b-4ce5-4d64-96d6-f8aa9eb0268f tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:12.802449 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-7560c03b-4ce5-4d64-96d6-f8aa9eb0268f tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:12.803132 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-7560c03b-4ce5-4d64-96d6-f8aa9eb0268f tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:12.803585 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-7560c03b-4ce5-4d64-96d6-f8aa9eb0268f tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:12.804599 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-7560c03b-4ce5-4d64-96d6-f8aa9eb0268f tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:12.934314 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-7560c03b-4ce5-4d64-96d6-f8aa9eb0268f tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c1b55b5c04ba380ed8ffdaa462bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa6bd99403b4421acb8bd714c9450c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:12.942150 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-7560c03b-4ce5-4d64-96d6-f8aa9eb0268f tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] 10.222.0.52 "GET /compute/v2.1/servers/0e97301c-3a01-452d-b54a-6bf66c4793d9" status: 200 len: 1314 microversion: 2.1 time: 0.151180 Oct 28 09:48:12.942722 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 131/251] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:48:12 2022] GET /compute/v2.1/servers/0e97301c-3a01-452d-b54a-6bf66c4793d9 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:48:13.006171 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-34e752aa-f49b-40e5-a25a-76ad849dce65 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:13.006779 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-34e752aa-f49b-40e5-a25a-76ad849dce65 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: 1eaf7cc8-63d3-40c6-b5f5-e4e978ddfe17] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:13.013889 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-34e752aa-f49b-40e5-a25a-76ad849dce65 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:13.014406 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-34e752aa-f49b-40e5-a25a-76ad849dce65 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:13.014837 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-34e752aa-f49b-40e5-a25a-76ad849dce65 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:13.015529 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-34e752aa-f49b-40e5-a25a-76ad849dce65 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:13.016050 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-34e752aa-f49b-40e5-a25a-76ad849dce65 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:13.016472 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-34e752aa-f49b-40e5-a25a-76ad849dce65 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:13.232035 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-a94b1b36-6a00-4f01-83d3-4f6c9a2df096 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:13.232649 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-a94b1b36-6a00-4f01-83d3-4f6c9a2df096 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] [instance: 7ab20f71-d81e-4b6a-90f0-e4b0873c0469] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:13.239121 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-a94b1b36-6a00-4f01-83d3-4f6c9a2df096 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:13.239735 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-a94b1b36-6a00-4f01-83d3-4f6c9a2df096 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:13.240194 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-a94b1b36-6a00-4f01-83d3-4f6c9a2df096 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:13.241820 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-a94b1b36-6a00-4f01-83d3-4f6c9a2df096 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:13.242401 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-a94b1b36-6a00-4f01-83d3-4f6c9a2df096 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:13.242859 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-a94b1b36-6a00-4f01-83d3-4f6c9a2df096 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:13.303044 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-34e752aa-f49b-40e5-a25a-76ad849dce65 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe6eb38e8df492daaef5755ddea7773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234f69f21d7a456a9ab6a86c4ac2ede2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:13.317129 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-34e752aa-f49b-40e5-a25a-76ad849dce65 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] 10.222.0.52 "GET /compute/v2.1/servers/1eaf7cc8-63d3-40c6-b5f5-e4e978ddfe17" status: 200 len: 1522 microversion: 2.1 time: 0.314877 Oct 28 09:48:13.317718 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 121/252] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:48:13 2022] GET /compute/v2.1/servers/1eaf7cc8-63d3-40c6-b5f5-e4e978ddfe17 => generated 1522 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:48:13.388809 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-a94b1b36-6a00-4f01-83d3-4f6c9a2df096 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05718633def4ad6822728767580b810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89c15d74a584be3b5e44f74ed50eea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:13.396623 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-a94b1b36-6a00-4f01-83d3-4f6c9a2df096 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] 10.222.0.52 "GET /compute/v2.1/servers/7ab20f71-d81e-4b6a-90f0-e4b0873c0469" status: 200 len: 1315 microversion: 2.1 time: 0.168713 Oct 28 09:48:13.397123 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 132/253] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:48:13 2022] GET /compute/v2.1/servers/7ab20f71-d81e-4b6a-90f0-e4b0873c0469 => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:48:13.965547 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-c50a25b9-ec65-4e77-83c8-de82ab4abd9c tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:13.966153 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-c50a25b9-ec65-4e77-83c8-de82ab4abd9c tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] [instance: 0e97301c-3a01-452d-b54a-6bf66c4793d9] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:13.972394 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-c50a25b9-ec65-4e77-83c8-de82ab4abd9c tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:13.972675 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-c50a25b9-ec65-4e77-83c8-de82ab4abd9c tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:13.973107 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-c50a25b9-ec65-4e77-83c8-de82ab4abd9c tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:13.974178 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-c50a25b9-ec65-4e77-83c8-de82ab4abd9c tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:13.974305 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-c50a25b9-ec65-4e77-83c8-de82ab4abd9c tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:13.974649 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-c50a25b9-ec65-4e77-83c8-de82ab4abd9c tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:14.110579 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-c50a25b9-ec65-4e77-83c8-de82ab4abd9c tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c1b55b5c04ba380ed8ffdaa462bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa6bd99403b4421acb8bd714c9450c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:14.119998 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-c50a25b9-ec65-4e77-83c8-de82ab4abd9c tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] 10.222.0.52 "GET /compute/v2.1/servers/0e97301c-3a01-452d-b54a-6bf66c4793d9" status: 200 len: 1314 microversion: 2.1 time: 0.158162 Oct 28 09:48:14.120910 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 122/254] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:48:13 2022] GET /compute/v2.1/servers/0e97301c-3a01-452d-b54a-6bf66c4793d9 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:48:14.158712 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [req-3b299c28-e6d8-45ce-85f0-11e2f5f041e8 req-6f0c56e4-7b38-43cd-9114-32db85526d97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ab20f71-d81e-4b6a-90f0-e4b0873c0469", "tag": "71eb0d61-47d4-42f9-ac21-8a556e555dae"}]} {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:48:14.169678 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-3b299c28-e6d8-45ce-85f0-11e2f5f041e8 req-6f0c56e4-7b38-43cd-9114-32db85526d97 service nova] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:14.170158 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-3b299c28-e6d8-45ce-85f0-11e2f5f041e8 req-6f0c56e4-7b38-43cd-9114-32db85526d97 service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:14.170584 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-3b299c28-e6d8-45ce-85f0-11e2f5f041e8 req-6f0c56e4-7b38-43cd-9114-32db85526d97 service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:14.184953 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.compute.server_external_events [req-3b299c28-e6d8-45ce-85f0-11e2f5f041e8 req-6f0c56e4-7b38-43cd-9114-32db85526d97 service nova] Creating event network-changed:71eb0d61-47d4-42f9-ac21-8a556e555dae for instance 7ab20f71-d81e-4b6a-90f0-e4b0873c0469 on hv-cinder-zed-3 Oct 28 09:48:14.189727 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [req-3b299c28-e6d8-45ce-85f0-11e2f5f041e8 req-6f0c56e4-7b38-43cd-9114-32db85526d97 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034698 Oct 28 09:48:14.190318 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 133/255] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Oct 28 09:48:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:48:14.341012 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-abc83d41-0d99-4d03-9305-a37b5a3b5de5 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:14.341629 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-abc83d41-0d99-4d03-9305-a37b5a3b5de5 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: 1eaf7cc8-63d3-40c6-b5f5-e4e978ddfe17] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:14.347662 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-abc83d41-0d99-4d03-9305-a37b5a3b5de5 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:14.348192 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-abc83d41-0d99-4d03-9305-a37b5a3b5de5 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:14.348631 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-abc83d41-0d99-4d03-9305-a37b5a3b5de5 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:14.349326 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-abc83d41-0d99-4d03-9305-a37b5a3b5de5 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:14.349784 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-abc83d41-0d99-4d03-9305-a37b5a3b5de5 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:14.350206 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-abc83d41-0d99-4d03-9305-a37b5a3b5de5 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:14.420993 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-e99bfbee-a98b-4423-9b48-bbc83e674a17 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:14.421796 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-e99bfbee-a98b-4423-9b48-bbc83e674a17 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] [instance: 7ab20f71-d81e-4b6a-90f0-e4b0873c0469] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:14.428625 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-e99bfbee-a98b-4423-9b48-bbc83e674a17 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:14.429737 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-e99bfbee-a98b-4423-9b48-bbc83e674a17 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:14.430230 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-e99bfbee-a98b-4423-9b48-bbc83e674a17 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:14.431222 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-e99bfbee-a98b-4423-9b48-bbc83e674a17 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:14.431531 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-e99bfbee-a98b-4423-9b48-bbc83e674a17 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:14.432044 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-e99bfbee-a98b-4423-9b48-bbc83e674a17 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:14.529422 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-abc83d41-0d99-4d03-9305-a37b5a3b5de5 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe6eb38e8df492daaef5755ddea7773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234f69f21d7a456a9ab6a86c4ac2ede2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:14.539351 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-abc83d41-0d99-4d03-9305-a37b5a3b5de5 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] 10.222.0.52 "GET /compute/v2.1/servers/1eaf7cc8-63d3-40c6-b5f5-e4e978ddfe17" status: 200 len: 1522 microversion: 2.1 time: 0.202329 Oct 28 09:48:14.540141 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 123/256] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:48:14 2022] GET /compute/v2.1/servers/1eaf7cc8-63d3-40c6-b5f5-e4e978ddfe17 => generated 1522 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:48:14.594616 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-e99bfbee-a98b-4423-9b48-bbc83e674a17 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05718633def4ad6822728767580b810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89c15d74a584be3b5e44f74ed50eea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:14.604206 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-e99bfbee-a98b-4423-9b48-bbc83e674a17 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] 10.222.0.52 "GET /compute/v2.1/servers/7ab20f71-d81e-4b6a-90f0-e4b0873c0469" status: 200 len: 1315 microversion: 2.1 time: 0.187670 Oct 28 09:48:14.604858 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 134/257] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:48:14 2022] GET /compute/v2.1/servers/7ab20f71-d81e-4b6a-90f0-e4b0873c0469 => generated 1315 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:48:15.145143 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-e6ec2d0e-8ffa-40bb-8bbb-05fcd1cef0c5 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:15.145867 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-e6ec2d0e-8ffa-40bb-8bbb-05fcd1cef0c5 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] [instance: 0e97301c-3a01-452d-b54a-6bf66c4793d9] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:15.153062 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-e6ec2d0e-8ffa-40bb-8bbb-05fcd1cef0c5 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:15.153545 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-e6ec2d0e-8ffa-40bb-8bbb-05fcd1cef0c5 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:15.153975 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-e6ec2d0e-8ffa-40bb-8bbb-05fcd1cef0c5 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:15.154667 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-e6ec2d0e-8ffa-40bb-8bbb-05fcd1cef0c5 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:15.155120 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-e6ec2d0e-8ffa-40bb-8bbb-05fcd1cef0c5 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:15.155543 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-e6ec2d0e-8ffa-40bb-8bbb-05fcd1cef0c5 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:15.296080 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-e6ec2d0e-8ffa-40bb-8bbb-05fcd1cef0c5 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c1b55b5c04ba380ed8ffdaa462bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa6bd99403b4421acb8bd714c9450c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:15.304152 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-e6ec2d0e-8ffa-40bb-8bbb-05fcd1cef0c5 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] 10.222.0.52 "GET /compute/v2.1/servers/0e97301c-3a01-452d-b54a-6bf66c4793d9" status: 200 len: 1499 microversion: 2.1 time: 0.162740 Oct 28 09:48:15.304752 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 124/258] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:48:15 2022] GET /compute/v2.1/servers/0e97301c-3a01-452d-b54a-6bf66c4793d9 => generated 1499 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:48:15.564077 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-4c42fce8-782d-41fa-b6f0-79be42f2b94d tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:15.566067 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-4c42fce8-782d-41fa-b6f0-79be42f2b94d tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: 1eaf7cc8-63d3-40c6-b5f5-e4e978ddfe17] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:15.574244 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-4c42fce8-782d-41fa-b6f0-79be42f2b94d tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:15.574653 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-4c42fce8-782d-41fa-b6f0-79be42f2b94d tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:15.575709 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-4c42fce8-782d-41fa-b6f0-79be42f2b94d tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:15.577896 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-4c42fce8-782d-41fa-b6f0-79be42f2b94d tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:15.578403 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-4c42fce8-782d-41fa-b6f0-79be42f2b94d tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:15.582567 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-4c42fce8-782d-41fa-b6f0-79be42f2b94d tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:15.630157 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-a6629daa-557b-49d1-8fe0-b1c60ea87e5a tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:15.630849 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-a6629daa-557b-49d1-8fe0-b1c60ea87e5a tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] [instance: 7ab20f71-d81e-4b6a-90f0-e4b0873c0469] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:15.637847 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-a6629daa-557b-49d1-8fe0-b1c60ea87e5a tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:15.638341 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-a6629daa-557b-49d1-8fe0-b1c60ea87e5a tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:15.638777 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-a6629daa-557b-49d1-8fe0-b1c60ea87e5a tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:15.639480 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-a6629daa-557b-49d1-8fe0-b1c60ea87e5a tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:15.640281 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-a6629daa-557b-49d1-8fe0-b1c60ea87e5a tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:15.641086 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-a6629daa-557b-49d1-8fe0-b1c60ea87e5a tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:15.796799 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-4c42fce8-782d-41fa-b6f0-79be42f2b94d tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe6eb38e8df492daaef5755ddea7773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234f69f21d7a456a9ab6a86c4ac2ede2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:15.809929 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-4c42fce8-782d-41fa-b6f0-79be42f2b94d tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] 10.222.0.52 "GET /compute/v2.1/servers/1eaf7cc8-63d3-40c6-b5f5-e4e978ddfe17" status: 200 len: 1502 microversion: 2.1 time: 0.249662 Oct 28 09:48:15.811224 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 135/259] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:48:15 2022] GET /compute/v2.1/servers/1eaf7cc8-63d3-40c6-b5f5-e4e978ddfe17 => generated 1502 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:48:15.825403 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-a6629daa-557b-49d1-8fe0-b1c60ea87e5a tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05718633def4ad6822728767580b810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89c15d74a584be3b5e44f74ed50eea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:15.833726 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-a6629daa-557b-49d1-8fe0-b1c60ea87e5a tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] 10.222.0.52 "GET /compute/v2.1/servers/7ab20f71-d81e-4b6a-90f0-e4b0873c0469" status: 200 len: 1315 microversion: 2.1 time: 0.209371 Oct 28 09:48:15.834392 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 125/260] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:48:15 2022] GET /compute/v2.1/servers/7ab20f71-d81e-4b6a-90f0-e4b0873c0469 => generated 1315 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:48:15.834979 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-9d60789c-7519-4ead-894c-ebea86b9cb62 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9a752f99-0f5e-47d5-af1c-8508e4c25874"}} {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:48:15.837486 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-9d60789c-7519-4ead-894c-ebea86b9cb62 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: 1eaf7cc8-63d3-40c6-b5f5-e4e978ddfe17] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:15.843863 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-9d60789c-7519-4ead-894c-ebea86b9cb62 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:15.844370 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-9d60789c-7519-4ead-894c-ebea86b9cb62 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:15.844802 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-9d60789c-7519-4ead-894c-ebea86b9cb62 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:15.845490 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-9d60789c-7519-4ead-894c-ebea86b9cb62 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:15.845941 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-9d60789c-7519-4ead-894c-ebea86b9cb62 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:15.846360 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-9d60789c-7519-4ead-894c-ebea86b9cb62 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:15.871208 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.wsgi [None req-9d60789c-7519-4ead-894c-ebea86b9cb62 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] HTTP exception thrown: Cannot 'attach_volume' instance 1eaf7cc8-63d3-40c6-b5f5-e4e978ddfe17 while it is in vm_state rescued Oct 28 09:48:15.872926 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-9d60789c-7519-4ead-894c-ebea86b9cb62 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Request method failure captured: Oct 28 09:48:15.872926 dv-cinder-zed-3-smb devstack@n-api.service[127033]: request: POST /compute/v2.1/servers/1eaf7cc8-63d3-40c6-b5f5-e4e978ddfe17/os-volume_attachments HTTP/1.1 Oct 28 09:48:15.872926 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Accept: application/json Oct 28 09:48:15.872926 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Accept-Encoding: identity Oct 28 09:48:15.872926 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Connection: close Oct 28 09:48:15.872926 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Content-Length: 74 Oct 28 09:48:15.872926 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Content-Type: application/json Oct 28 09:48:15.872926 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Host: 10.222.0.52 Oct 28 09:48:15.872926 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Openstack-System-Scope: None Oct 28 09:48:15.872926 dv-cinder-zed-3-smb devstack@n-api.service[127033]: User-Agent: python-urllib3/1.26.12 Oct 28 09:48:15.872926 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Auth-Token: gAAAAABjW6UMBLZAcB4ofCUEvyoCWt-nTaXzdGXaOtWjwHccK7VrtFAzPPGWsQagqFaH1IBUrfHYI_AtqGoeSDCkxIRD0lzPZ7kumCvA3AUFB0eRrG8vOtKEHyKYUVg_hZG8huan0rPnrbQu2YqOny3faW5JsiVxHZMfNsP73PBj_XjtK1wa1N8 Oct 28 09:48:15.872926 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Domain-Id: None Oct 28 09:48:15.872926 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Domain-Name: None Oct 28 09:48:15.872926 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Identity-Status: Confirmed Oct 28 09:48:15.872926 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Is-Admin-Project: True Oct 28 09:48:15.872926 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Project-Domain-Id: default Oct 28 09:48:15.872926 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Project-Domain-Name: Default Oct 28 09:48:15.872926 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Project-Id: 234f69f21d7a456a9ab6a86c4ac2ede2 Oct 28 09:48:15.872926 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1058371291 Oct 28 09:48:15.872926 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Role: reader,member Oct 28 09:48:15.872926 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Roles: reader,member Oct 28 09:48:15.874483 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_234f69f21d7a456a9ab6a86c4ac2ede2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/234f69f21d7a456a9ab6a86c4ac2ede2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/234f69f21d7a456a9ab6a86c4ac2ede2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/234f69f21d7a456a9ab6a86c4ac2ede2"}]}] Oct 28 09:48:15.874483 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1058371291 Oct 28 09:48:15.874483 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Tenant-Id: 234f69f21d7a456a9ab6a86c4ac2ede2 Oct 28 09:48:15.874483 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1058371291 Oct 28 09:48:15.874483 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User: tempest-ServerRescueNegativeTestJSON-1058371291-project Oct 28 09:48:15.874483 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User-Domain-Id: default Oct 28 09:48:15.874483 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User-Domain-Name: Default Oct 28 09:48:15.874483 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User-Id: cfe6eb38e8df492daaef5755ddea7773 Oct 28 09:48:15.874483 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1058371291-project Oct 28 09:48:15.874483 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Oct 28 09:48:15.874483 dv-cinder-zed-3-smb devstack@n-api.service[127033]: {"volumeAttachment": {"volumeId": "9a752f99-0f5e-47d5-af1c-8508e4c25874"}} Oct 28 09:48:15.874483 dv-cinder-zed-3-smb devstack@n-api.service[127033]: method: > Oct 28 09:48:15.875442 dv-cinder-zed-3-smb devstack@n-api.service[127033]: exception: Cannot 'attach_volume' instance 1eaf7cc8-63d3-40c6-b5f5-e4e978ddfe17 while it is in vm_state rescued Oct 28 09:48:15.875442 dv-cinder-zed-3-smb devstack@n-api.service[127033]: action_args: {'server_id': '1eaf7cc8-63d3-40c6-b5f5-e4e978ddfe17', 'body': {'volumeAttachment': {'volumeId': '9a752f99-0f5e-47d5-af1c-8508e4c25874'}}} Oct 28 09:48:15.875442 dv-cinder-zed-3-smb devstack@n-api.service[127033]: {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:48:15.875442 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:48:15.875442 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 28 09:48:15.875442 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 28 09:48:15.875442 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 28 09:48:15.875442 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 09:48:15.875442 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 28 09:48:15.875442 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 28 09:48:15.875442 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 1eaf7cc8-63d3-40c6-b5f5-e4e978ddfe17 in vm_state rescued. Cannot attach_volume while the instance is in this state. Oct 28 09:48:15.875442 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:48:15.875442 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:48:15.875442 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:48:15.875442 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:48:15.875442 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:48:15.875442 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:48:15.875442 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:48:15.875442 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:48:15.876986 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:48:15.876986 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:48:15.876986 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 09:48:15.876986 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 09:48:15.876986 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 09:48:15.876986 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 09:48:15.876986 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 09:48:15.876986 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 09:48:15.876986 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Oct 28 09:48:15.876986 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 28 09:48:15.876986 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 28 09:48:15.876986 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 28 09:48:15.876986 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 1eaf7cc8-63d3-40c6-b5f5-e4e978ddfe17 while it is in vm_state rescued Oct 28 09:48:15.876986 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:48:15.876986 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:48:15.876986 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:48:15.876986 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:48:15.876986 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:48:15.876986 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:48:15.878351 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:48:15.878351 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:48:15.878351 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 1eaf7cc8-63d3-40c6-b5f5-e4e978ddfe17 while it is in vm_state rescued Oct 28 09:48:15.878351 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:48:15.878351 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-9d60789c-7519-4ead-894c-ebea86b9cb62 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Returning 409 to user: Cannot 'attach_volume' instance 1eaf7cc8-63d3-40c6-b5f5-e4e978ddfe17 while it is in vm_state rescued {{(pid=127033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:48:15.878351 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-9d60789c-7519-4ead-894c-ebea86b9cb62 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] 10.222.0.52 "POST /compute/v2.1/servers/1eaf7cc8-63d3-40c6-b5f5-e4e978ddfe17/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.043674 Oct 28 09:48:15.878351 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 136/261] 10.222.0.52 () {60 vars in 1323 bytes} [Fri Oct 28 09:48:15 2022] POST /compute/v2.1/servers/1eaf7cc8-63d3-40c6-b5f5-e4e978ddfe17/os-volume_attachments => generated 152 bytes in 45 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 28 09:48:15.884702 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-7455ffc9-684d-44b9-bffb-63de2825906d tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:48:15.885235 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-7455ffc9-684d-44b9-bffb-63de2825906d tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: 1eaf7cc8-63d3-40c6-b5f5-e4e978ddfe17] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:15.891220 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-7455ffc9-684d-44b9-bffb-63de2825906d tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:15.891702 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-7455ffc9-684d-44b9-bffb-63de2825906d tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:15.892170 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-7455ffc9-684d-44b9-bffb-63de2825906d tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:15.892865 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-7455ffc9-684d-44b9-bffb-63de2825906d tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:15.893317 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-7455ffc9-684d-44b9-bffb-63de2825906d tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:15.893734 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-7455ffc9-684d-44b9-bffb-63de2825906d tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:15.963735 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-7455ffc9-684d-44b9-bffb-63de2825906d tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] 10.222.0.52 "POST /compute/v2.1/servers/1eaf7cc8-63d3-40c6-b5f5-e4e978ddfe17/action" status: 202 len: 0 microversion: 2.1 time: 0.083890 Oct 28 09:48:15.964620 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 126/262] 10.222.0.52 () {60 vars in 1278 bytes} [Fri Oct 28 09:48:15 2022] POST /compute/v2.1/servers/1eaf7cc8-63d3-40c6-b5f5-e4e978ddfe17/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:48:15.972750 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-8358728b-6aa5-4c04-b647-42531532a7c9 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:15.973364 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-8358728b-6aa5-4c04-b647-42531532a7c9 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: 1eaf7cc8-63d3-40c6-b5f5-e4e978ddfe17] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:15.979481 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-8358728b-6aa5-4c04-b647-42531532a7c9 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:15.980013 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-8358728b-6aa5-4c04-b647-42531532a7c9 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:15.980450 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-8358728b-6aa5-4c04-b647-42531532a7c9 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:15.981414 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-8358728b-6aa5-4c04-b647-42531532a7c9 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:15.981866 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-8358728b-6aa5-4c04-b647-42531532a7c9 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:15.982286 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-8358728b-6aa5-4c04-b647-42531532a7c9 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:16.137459 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-8358728b-6aa5-4c04-b647-42531532a7c9 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe6eb38e8df492daaef5755ddea7773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234f69f21d7a456a9ab6a86c4ac2ede2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:16.168668 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-8358728b-6aa5-4c04-b647-42531532a7c9 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] 10.222.0.52 "GET /compute/v2.1/servers/1eaf7cc8-63d3-40c6-b5f5-e4e978ddfe17" status: 200 len: 1510 microversion: 2.1 time: 0.199719 Oct 28 09:48:16.169201 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 137/263] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:48:15 2022] GET /compute/v2.1/servers/1eaf7cc8-63d3-40c6-b5f5-e4e978ddfe17 => generated 1510 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:48:16.237461 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-1c025d8c-3fb2-4461-b4e2-5969d75b2d60 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:16.237967 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-1c025d8c-3fb2-4461-b4e2-5969d75b2d60 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] [instance: 0e97301c-3a01-452d-b54a-6bf66c4793d9] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:16.244678 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-1c025d8c-3fb2-4461-b4e2-5969d75b2d60 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:16.245173 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-1c025d8c-3fb2-4461-b4e2-5969d75b2d60 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:16.245606 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-1c025d8c-3fb2-4461-b4e2-5969d75b2d60 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:16.246322 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-1c025d8c-3fb2-4461-b4e2-5969d75b2d60 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:16.246806 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-1c025d8c-3fb2-4461-b4e2-5969d75b2d60 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:16.247217 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-1c025d8c-3fb2-4461-b4e2-5969d75b2d60 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:16.251963 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG dbcounter [-] [127033] Writing DB stats nova_cell1:SELECT=100 {{(pid=127033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:48:16.276171 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-1c025d8c-3fb2-4461-b4e2-5969d75b2d60 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] [instance: 0e97301c-3a01-452d-b54a-6bf66c4793d9] Going to try to terminate instance {{(pid=127033) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 09:48:16.340585 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG dbcounter [-] [127033] Writing DB stats nova_cell0:SELECT=2 {{(pid=127033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:48:16.360625 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [req-044355f9-300c-4cfe-816a-8ca854730a5c req-5ef0bf2d-98e4-4cfa-9272-bdb7401c53f7 admin admin] Action: 'create', calling method: >, body: {"snapshot": {"volume_id": "4adfb3fc-0236-45dc-a5b9-1e3c07a57b4b", "create_info": {"type": "qcow2", "new_file": "volume-4adfb3fc-0236-45dc-a5b9-1e3c07a57b4b.af9eab3a-ae78-4e8c-8045-e0c460805867.vhdx", "snapshot_id": "af9eab3a-ae78-4e8c-8045-e0c460805867"}}} {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:48:16.365092 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG dbcounter [-] [127033] Writing DB stats nova_cell0:SELECT=6 {{(pid=127033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:48:16.368378 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [req-044355f9-300c-4cfe-816a-8ca854730a5c req-5ef0bf2d-98e4-4cfa-9272-bdb7401c53f7 admin admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2b15302a-f4a0-4e7f-8af3-7ee6eb916adf(cell1) {{(pid=127032) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 28 09:48:16.368995 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-044355f9-300c-4cfe-816a-8ca854730a5c req-5ef0bf2d-98e4-4cfa-9272-bdb7401c53f7 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:16.369879 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-044355f9-300c-4cfe-816a-8ca854730a5c req-5ef0bf2d-98e4-4cfa-9272-bdb7401c53f7 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:16.370345 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-044355f9-300c-4cfe-816a-8ca854730a5c req-5ef0bf2d-98e4-4cfa-9272-bdb7401c53f7 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:16.370931 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-1c025d8c-3fb2-4461-b4e2-5969d75b2d60 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] 10.222.0.52 "DELETE /compute/v2.1/servers/0e97301c-3a01-452d-b54a-6bf66c4793d9" status: 204 len: 0 microversion: 2.1 time: 0.137180 Oct 28 09:48:16.371896 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 138/264] 10.222.0.52 () {58 vars in 1239 bytes} [Fri Oct 28 09:48:16 2022] DELETE /compute/v2.1/servers/0e97301c-3a01-452d-b54a-6bf66c4793d9 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 28 09:48:16.383007 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-4f6d60c0-8c4f-42c7-a25b-cf7a44ef890a tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:16.383925 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-4f6d60c0-8c4f-42c7-a25b-cf7a44ef890a tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] [instance: 0e97301c-3a01-452d-b54a-6bf66c4793d9] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:16.391919 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-4f6d60c0-8c4f-42c7-a25b-cf7a44ef890a tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:16.392564 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-4f6d60c0-8c4f-42c7-a25b-cf7a44ef890a tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:16.393041 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-4f6d60c0-8c4f-42c7-a25b-cf7a44ef890a tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:16.394460 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-4f6d60c0-8c4f-42c7-a25b-cf7a44ef890a tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:16.394460 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-4f6d60c0-8c4f-42c7-a25b-cf7a44ef890a tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:16.394995 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-4f6d60c0-8c4f-42c7-a25b-cf7a44ef890a tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:16.416948 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-044355f9-300c-4cfe-816a-8ca854730a5c req-5ef0bf2d-98e4-4cfa-9272-bdb7401c53f7 admin admin] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:16.416948 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-044355f9-300c-4cfe-816a-8ca854730a5c req-5ef0bf2d-98e4-4cfa-9272-bdb7401c53f7 admin admin] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:16.416948 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-044355f9-300c-4cfe-816a-8ca854730a5c req-5ef0bf2d-98e4-4cfa-9272-bdb7401c53f7 admin admin] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:16.443278 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [req-044355f9-300c-4cfe-816a-8ca854730a5c req-5ef0bf2d-98e4-4cfa-9272-bdb7401c53f7 admin admin] 10.222.0.58 "POST /compute/v2.1/os-assisted-volume-snapshots" status: 200 len: 78 microversion: 2.1 time: 0.234951 Oct 28 09:48:16.444126 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 127/265] 10.222.0.58 () {64 vars in 1326 bytes} [Fri Oct 28 09:48:16 2022] POST /compute/v2.1/os-assisted-volume-snapshots => generated 78 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 09:48:16.536000 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-4f6d60c0-8c4f-42c7-a25b-cf7a44ef890a tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c1b55b5c04ba380ed8ffdaa462bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa6bd99403b4421acb8bd714c9450c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:16.544530 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-4f6d60c0-8c4f-42c7-a25b-cf7a44ef890a tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] 10.222.0.52 "GET /compute/v2.1/servers/0e97301c-3a01-452d-b54a-6bf66c4793d9" status: 200 len: 1505 microversion: 2.1 time: 0.168106 Oct 28 09:48:16.545117 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 139/266] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:48:16 2022] GET /compute/v2.1/servers/0e97301c-3a01-452d-b54a-6bf66c4793d9 => generated 1505 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:48:16.854618 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG dbcounter [-] [127032] Writing DB stats nova_cell0:SELECT=10 {{(pid=127032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:48:16.859862 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-5a4723a1-51ec-4c22-896c-d0196d404aa0 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:16.860599 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-5a4723a1-51ec-4c22-896c-d0196d404aa0 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] [instance: 7ab20f71-d81e-4b6a-90f0-e4b0873c0469] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:16.867156 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-5a4723a1-51ec-4c22-896c-d0196d404aa0 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:16.867631 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-5a4723a1-51ec-4c22-896c-d0196d404aa0 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:16.868081 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-5a4723a1-51ec-4c22-896c-d0196d404aa0 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:16.868755 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-5a4723a1-51ec-4c22-896c-d0196d404aa0 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:16.869204 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-5a4723a1-51ec-4c22-896c-d0196d404aa0 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:16.869616 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-5a4723a1-51ec-4c22-896c-d0196d404aa0 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:17.001512 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-5a4723a1-51ec-4c22-896c-d0196d404aa0 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05718633def4ad6822728767580b810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89c15d74a584be3b5e44f74ed50eea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:17.009861 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-5a4723a1-51ec-4c22-896c-d0196d404aa0 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] 10.222.0.52 "GET /compute/v2.1/servers/7ab20f71-d81e-4b6a-90f0-e4b0873c0469" status: 200 len: 1315 microversion: 2.1 time: 0.156275 Oct 28 09:48:17.010425 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 128/267] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:48:16 2022] GET /compute/v2.1/servers/7ab20f71-d81e-4b6a-90f0-e4b0873c0469 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:48:17.192793 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-7b562741-4e25-4e3d-8ad3-a33b52da1b53 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:17.193401 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-7b562741-4e25-4e3d-8ad3-a33b52da1b53 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: 1eaf7cc8-63d3-40c6-b5f5-e4e978ddfe17] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:17.200463 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-7b562741-4e25-4e3d-8ad3-a33b52da1b53 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:17.200944 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-7b562741-4e25-4e3d-8ad3-a33b52da1b53 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:17.201375 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-7b562741-4e25-4e3d-8ad3-a33b52da1b53 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:17.202058 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-7b562741-4e25-4e3d-8ad3-a33b52da1b53 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:17.202503 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-7b562741-4e25-4e3d-8ad3-a33b52da1b53 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:17.202919 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-7b562741-4e25-4e3d-8ad3-a33b52da1b53 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:17.328351 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-7b562741-4e25-4e3d-8ad3-a33b52da1b53 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe6eb38e8df492daaef5755ddea7773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234f69f21d7a456a9ab6a86c4ac2ede2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:17.335968 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-7b562741-4e25-4e3d-8ad3-a33b52da1b53 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] 10.222.0.52 "GET /compute/v2.1/servers/1eaf7cc8-63d3-40c6-b5f5-e4e978ddfe17" status: 200 len: 1510 microversion: 2.1 time: 0.146976 Oct 28 09:48:17.336536 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 140/268] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:48:17 2022] GET /compute/v2.1/servers/1eaf7cc8-63d3-40c6-b5f5-e4e978ddfe17 => generated 1510 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:48:17.569494 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-127657cb-3a1d-4f92-90e8-439418254a44 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:17.570097 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-127657cb-3a1d-4f92-90e8-439418254a44 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] [instance: 0e97301c-3a01-452d-b54a-6bf66c4793d9] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:17.576487 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-127657cb-3a1d-4f92-90e8-439418254a44 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:17.576969 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-127657cb-3a1d-4f92-90e8-439418254a44 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:17.577399 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-127657cb-3a1d-4f92-90e8-439418254a44 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:17.578083 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-127657cb-3a1d-4f92-90e8-439418254a44 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:17.578568 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-127657cb-3a1d-4f92-90e8-439418254a44 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:17.579005 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-127657cb-3a1d-4f92-90e8-439418254a44 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:17.706419 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-127657cb-3a1d-4f92-90e8-439418254a44 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c1b55b5c04ba380ed8ffdaa462bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa6bd99403b4421acb8bd714c9450c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:17.714227 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-127657cb-3a1d-4f92-90e8-439418254a44 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] 10.222.0.52 "GET /compute/v2.1/servers/0e97301c-3a01-452d-b54a-6bf66c4793d9" status: 200 len: 1505 microversion: 2.1 time: 0.148627 Oct 28 09:48:17.714827 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 129/269] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:48:17 2022] GET /compute/v2.1/servers/0e97301c-3a01-452d-b54a-6bf66c4793d9 => generated 1505 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:48:18.033009 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-82b82c1c-e141-4af2-a808-abc5a43be167 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:18.033615 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-82b82c1c-e141-4af2-a808-abc5a43be167 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] [instance: 7ab20f71-d81e-4b6a-90f0-e4b0873c0469] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:18.039523 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-82b82c1c-e141-4af2-a808-abc5a43be167 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:18.040044 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-82b82c1c-e141-4af2-a808-abc5a43be167 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:18.040483 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-82b82c1c-e141-4af2-a808-abc5a43be167 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:18.041168 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-82b82c1c-e141-4af2-a808-abc5a43be167 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:18.041629 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-82b82c1c-e141-4af2-a808-abc5a43be167 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:18.042052 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-82b82c1c-e141-4af2-a808-abc5a43be167 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:18.176830 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-82b82c1c-e141-4af2-a808-abc5a43be167 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05718633def4ad6822728767580b810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89c15d74a584be3b5e44f74ed50eea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:18.184597 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-82b82c1c-e141-4af2-a808-abc5a43be167 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] 10.222.0.52 "GET /compute/v2.1/servers/7ab20f71-d81e-4b6a-90f0-e4b0873c0469" status: 200 len: 1315 microversion: 2.1 time: 0.155421 Oct 28 09:48:18.185165 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 141/270] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:48:18 2022] GET /compute/v2.1/servers/7ab20f71-d81e-4b6a-90f0-e4b0873c0469 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:48:18.359161 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-073bbcf1-b50f-4c5e-ad5a-76d6a90af8df tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:18.359839 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-073bbcf1-b50f-4c5e-ad5a-76d6a90af8df tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: 1eaf7cc8-63d3-40c6-b5f5-e4e978ddfe17] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:18.366819 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-073bbcf1-b50f-4c5e-ad5a-76d6a90af8df tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:18.367303 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-073bbcf1-b50f-4c5e-ad5a-76d6a90af8df tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:18.367767 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-073bbcf1-b50f-4c5e-ad5a-76d6a90af8df tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:18.368458 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-073bbcf1-b50f-4c5e-ad5a-76d6a90af8df tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:18.368908 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-073bbcf1-b50f-4c5e-ad5a-76d6a90af8df tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:18.369340 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-073bbcf1-b50f-4c5e-ad5a-76d6a90af8df tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:18.496163 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-073bbcf1-b50f-4c5e-ad5a-76d6a90af8df tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe6eb38e8df492daaef5755ddea7773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234f69f21d7a456a9ab6a86c4ac2ede2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:18.503805 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-073bbcf1-b50f-4c5e-ad5a-76d6a90af8df tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] 10.222.0.52 "GET /compute/v2.1/servers/1eaf7cc8-63d3-40c6-b5f5-e4e978ddfe17" status: 200 len: 1510 microversion: 2.1 time: 0.148786 Oct 28 09:48:18.504370 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 130/271] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:48:18 2022] GET /compute/v2.1/servers/1eaf7cc8-63d3-40c6-b5f5-e4e978ddfe17 => generated 1510 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:48:18.737242 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-63799284-137e-4a13-bd0a-3db11bb536c4 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:18.737846 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-63799284-137e-4a13-bd0a-3db11bb536c4 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] [instance: 0e97301c-3a01-452d-b54a-6bf66c4793d9] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:18.744705 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-63799284-137e-4a13-bd0a-3db11bb536c4 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:18.745188 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-63799284-137e-4a13-bd0a-3db11bb536c4 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:18.745612 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-63799284-137e-4a13-bd0a-3db11bb536c4 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:18.746296 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-63799284-137e-4a13-bd0a-3db11bb536c4 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:18.746742 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-63799284-137e-4a13-bd0a-3db11bb536c4 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:18.747161 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-63799284-137e-4a13-bd0a-3db11bb536c4 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:18.877361 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-63799284-137e-4a13-bd0a-3db11bb536c4 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c1b55b5c04ba380ed8ffdaa462bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa6bd99403b4421acb8bd714c9450c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:18.885934 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-63799284-137e-4a13-bd0a-3db11bb536c4 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] 10.222.0.52 "GET /compute/v2.1/servers/0e97301c-3a01-452d-b54a-6bf66c4793d9" status: 200 len: 1505 microversion: 2.1 time: 0.152460 Oct 28 09:48:18.886511 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 142/272] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:48:18 2022] GET /compute/v2.1/servers/0e97301c-3a01-452d-b54a-6bf66c4793d9 => generated 1505 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:48:19.207084 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-cca9669b-121c-4c5c-86b9-a18639ac9790 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:19.207688 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-cca9669b-121c-4c5c-86b9-a18639ac9790 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] [instance: 7ab20f71-d81e-4b6a-90f0-e4b0873c0469] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:19.214823 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-cca9669b-121c-4c5c-86b9-a18639ac9790 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:19.215305 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-cca9669b-121c-4c5c-86b9-a18639ac9790 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:19.215737 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-cca9669b-121c-4c5c-86b9-a18639ac9790 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:19.216444 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-cca9669b-121c-4c5c-86b9-a18639ac9790 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:19.216893 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-cca9669b-121c-4c5c-86b9-a18639ac9790 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:19.217311 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-cca9669b-121c-4c5c-86b9-a18639ac9790 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:19.344305 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-cca9669b-121c-4c5c-86b9-a18639ac9790 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05718633def4ad6822728767580b810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89c15d74a584be3b5e44f74ed50eea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:19.351888 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-cca9669b-121c-4c5c-86b9-a18639ac9790 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] 10.222.0.52 "GET /compute/v2.1/servers/7ab20f71-d81e-4b6a-90f0-e4b0873c0469" status: 200 len: 1315 microversion: 2.1 time: 0.148604 Oct 28 09:48:19.352456 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 131/273] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:48:19 2022] GET /compute/v2.1/servers/7ab20f71-d81e-4b6a-90f0-e4b0873c0469 => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:48:19.527409 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-5dd6adc5-2a4f-4518-a500-37d596b566e7 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:19.528045 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-5dd6adc5-2a4f-4518-a500-37d596b566e7 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: 1eaf7cc8-63d3-40c6-b5f5-e4e978ddfe17] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:19.534965 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-5dd6adc5-2a4f-4518-a500-37d596b566e7 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:19.535449 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-5dd6adc5-2a4f-4518-a500-37d596b566e7 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:19.535932 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-5dd6adc5-2a4f-4518-a500-37d596b566e7 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:19.536654 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-5dd6adc5-2a4f-4518-a500-37d596b566e7 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:19.537104 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-5dd6adc5-2a4f-4518-a500-37d596b566e7 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:19.537551 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-5dd6adc5-2a4f-4518-a500-37d596b566e7 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:19.672861 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-5dd6adc5-2a4f-4518-a500-37d596b566e7 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe6eb38e8df492daaef5755ddea7773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234f69f21d7a456a9ab6a86c4ac2ede2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:19.681119 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-5dd6adc5-2a4f-4518-a500-37d596b566e7 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] 10.222.0.52 "GET /compute/v2.1/servers/1eaf7cc8-63d3-40c6-b5f5-e4e978ddfe17" status: 200 len: 1510 microversion: 2.1 time: 0.157682 Oct 28 09:48:19.681687 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 143/274] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:48:19 2022] GET /compute/v2.1/servers/1eaf7cc8-63d3-40c6-b5f5-e4e978ddfe17 => generated 1510 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:48:19.909352 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-3d64bced-643f-40c1-b804-6369c066221e tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:19.909874 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-3d64bced-643f-40c1-b804-6369c066221e tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] [instance: 0e97301c-3a01-452d-b54a-6bf66c4793d9] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:19.916000 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-3d64bced-643f-40c1-b804-6369c066221e tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:19.916488 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-3d64bced-643f-40c1-b804-6369c066221e tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:19.916924 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-3d64bced-643f-40c1-b804-6369c066221e tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:19.917621 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-3d64bced-643f-40c1-b804-6369c066221e tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:19.918077 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-3d64bced-643f-40c1-b804-6369c066221e tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:19.918527 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-3d64bced-643f-40c1-b804-6369c066221e tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:20.058802 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-3d64bced-643f-40c1-b804-6369c066221e tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c1b55b5c04ba380ed8ffdaa462bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa6bd99403b4421acb8bd714c9450c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:20.069322 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-3d64bced-643f-40c1-b804-6369c066221e tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] 10.222.0.52 "GET /compute/v2.1/servers/0e97301c-3a01-452d-b54a-6bf66c4793d9" status: 200 len: 1505 microversion: 2.1 time: 0.163800 Oct 28 09:48:20.070412 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 132/275] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:48:19 2022] GET /compute/v2.1/servers/0e97301c-3a01-452d-b54a-6bf66c4793d9 => generated 1505 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:48:20.375203 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-445f73d0-3b77-435f-9d70-86743d3bd477 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:20.375906 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-445f73d0-3b77-435f-9d70-86743d3bd477 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] [instance: 7ab20f71-d81e-4b6a-90f0-e4b0873c0469] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:20.384244 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-445f73d0-3b77-435f-9d70-86743d3bd477 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:20.384738 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-445f73d0-3b77-435f-9d70-86743d3bd477 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:20.385177 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-445f73d0-3b77-435f-9d70-86743d3bd477 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:20.385880 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-445f73d0-3b77-435f-9d70-86743d3bd477 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:20.386337 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-445f73d0-3b77-435f-9d70-86743d3bd477 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:20.386764 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-445f73d0-3b77-435f-9d70-86743d3bd477 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:20.530643 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-445f73d0-3b77-435f-9d70-86743d3bd477 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05718633def4ad6822728767580b810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89c15d74a584be3b5e44f74ed50eea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:20.539199 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-445f73d0-3b77-435f-9d70-86743d3bd477 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] 10.222.0.52 "GET /compute/v2.1/servers/7ab20f71-d81e-4b6a-90f0-e4b0873c0469" status: 200 len: 1315 microversion: 2.1 time: 0.167849 Oct 28 09:48:20.539769 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 144/276] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:48:20 2022] GET /compute/v2.1/servers/7ab20f71-d81e-4b6a-90f0-e4b0873c0469 => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:48:20.705080 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-30fee4c9-c8dd-4968-998c-96c94ef89193 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:20.705679 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-30fee4c9-c8dd-4968-998c-96c94ef89193 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: 1eaf7cc8-63d3-40c6-b5f5-e4e978ddfe17] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:20.712615 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-30fee4c9-c8dd-4968-998c-96c94ef89193 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:20.713091 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-30fee4c9-c8dd-4968-998c-96c94ef89193 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:20.713525 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-30fee4c9-c8dd-4968-998c-96c94ef89193 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:20.714204 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-30fee4c9-c8dd-4968-998c-96c94ef89193 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:20.714655 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-30fee4c9-c8dd-4968-998c-96c94ef89193 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:20.715077 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-30fee4c9-c8dd-4968-998c-96c94ef89193 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:21.033579 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-30fee4c9-c8dd-4968-998c-96c94ef89193 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe6eb38e8df492daaef5755ddea7773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234f69f21d7a456a9ab6a86c4ac2ede2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:21.043506 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-30fee4c9-c8dd-4968-998c-96c94ef89193 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] 10.222.0.52 "GET /compute/v2.1/servers/1eaf7cc8-63d3-40c6-b5f5-e4e978ddfe17" status: 200 len: 1510 microversion: 2.1 time: 0.342198 Oct 28 09:48:21.044525 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 133/277] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:48:20 2022] GET /compute/v2.1/servers/1eaf7cc8-63d3-40c6-b5f5-e4e978ddfe17 => generated 1510 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:48:21.093463 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-5c068548-3006-46d0-9047-5a7d39651e4d tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:21.094163 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-5c068548-3006-46d0-9047-5a7d39651e4d tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] [instance: 0e97301c-3a01-452d-b54a-6bf66c4793d9] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:21.100208 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-5c068548-3006-46d0-9047-5a7d39651e4d tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:21.100833 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-5c068548-3006-46d0-9047-5a7d39651e4d tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:21.101834 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-5c068548-3006-46d0-9047-5a7d39651e4d tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:21.102575 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-5c068548-3006-46d0-9047-5a7d39651e4d tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:21.103112 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-5c068548-3006-46d0-9047-5a7d39651e4d tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:21.103592 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-5c068548-3006-46d0-9047-5a7d39651e4d tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:21.233474 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-5c068548-3006-46d0-9047-5a7d39651e4d tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c1b55b5c04ba380ed8ffdaa462bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa6bd99403b4421acb8bd714c9450c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:21.241356 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-5c068548-3006-46d0-9047-5a7d39651e4d tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] 10.222.0.52 "GET /compute/v2.1/servers/0e97301c-3a01-452d-b54a-6bf66c4793d9" status: 200 len: 1505 microversion: 2.1 time: 0.151720 Oct 28 09:48:21.241943 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 145/278] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:48:21 2022] GET /compute/v2.1/servers/0e97301c-3a01-452d-b54a-6bf66c4793d9 => generated 1505 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:48:21.422518 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [req-2d51c738-a10e-4cd2-8568-111e34ee1776 req-7b76fae7-178c-4e68-b464-8dfeaae53306 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e97301c-3a01-452d-b54a-6bf66c4793d9", "name": "network-vif-deleted", "tag": "bbde4e9b-6519-4264-9bd3-d11d2c951c54"}]} {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:48:21.434959 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-2d51c738-a10e-4cd2-8568-111e34ee1776 req-7b76fae7-178c-4e68-b464-8dfeaae53306 service nova] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:21.435439 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-2d51c738-a10e-4cd2-8568-111e34ee1776 req-7b76fae7-178c-4e68-b464-8dfeaae53306 service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:21.436104 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-2d51c738-a10e-4cd2-8568-111e34ee1776 req-7b76fae7-178c-4e68-b464-8dfeaae53306 service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:21.449874 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.compute.server_external_events [req-2d51c738-a10e-4cd2-8568-111e34ee1776 req-7b76fae7-178c-4e68-b464-8dfeaae53306 service nova] Creating event network-vif-deleted:bbde4e9b-6519-4264-9bd3-d11d2c951c54 for instance 0e97301c-3a01-452d-b54a-6bf66c4793d9 on hv-cinder-zed-3 Oct 28 09:48:21.455347 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [req-2d51c738-a10e-4cd2-8568-111e34ee1776 req-7b76fae7-178c-4e68-b464-8dfeaae53306 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036273 Oct 28 09:48:21.456024 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 134/279] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Oct 28 09:48:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:48:21.562454 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-e46cb8be-7aa3-451a-ad0d-1711677b1084 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:21.563123 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-e46cb8be-7aa3-451a-ad0d-1711677b1084 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] [instance: 7ab20f71-d81e-4b6a-90f0-e4b0873c0469] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:21.570073 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-e46cb8be-7aa3-451a-ad0d-1711677b1084 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:21.570560 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-e46cb8be-7aa3-451a-ad0d-1711677b1084 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:21.570997 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-e46cb8be-7aa3-451a-ad0d-1711677b1084 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:21.571682 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-e46cb8be-7aa3-451a-ad0d-1711677b1084 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:21.572185 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-e46cb8be-7aa3-451a-ad0d-1711677b1084 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:21.572592 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-e46cb8be-7aa3-451a-ad0d-1711677b1084 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:21.727360 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-e46cb8be-7aa3-451a-ad0d-1711677b1084 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05718633def4ad6822728767580b810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89c15d74a584be3b5e44f74ed50eea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:21.735512 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-e46cb8be-7aa3-451a-ad0d-1711677b1084 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] 10.222.0.52 "GET /compute/v2.1/servers/7ab20f71-d81e-4b6a-90f0-e4b0873c0469" status: 200 len: 1315 microversion: 2.1 time: 0.176963 Oct 28 09:48:21.736139 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 146/280] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:48:21 2022] GET /compute/v2.1/servers/7ab20f71-d81e-4b6a-90f0-e4b0873c0469 => generated 1315 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:48:22.067095 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-b43e64d8-602b-48dd-99d5-a74bfa766ffa tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:22.067921 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-b43e64d8-602b-48dd-99d5-a74bfa766ffa tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: 1eaf7cc8-63d3-40c6-b5f5-e4e978ddfe17] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:22.075460 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-b43e64d8-602b-48dd-99d5-a74bfa766ffa tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:22.076165 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-b43e64d8-602b-48dd-99d5-a74bfa766ffa tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:22.076469 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-b43e64d8-602b-48dd-99d5-a74bfa766ffa tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:22.077241 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-b43e64d8-602b-48dd-99d5-a74bfa766ffa tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:22.077717 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-b43e64d8-602b-48dd-99d5-a74bfa766ffa tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:22.078142 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-b43e64d8-602b-48dd-99d5-a74bfa766ffa tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:22.208485 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [req-7106e204-1fc7-42e0-b86b-0906fff6f69e req-fc18f2ac-2edd-4d39-820e-a04597085b05 admin admin] Action: 'create', calling method: >, body: {"snapshot": {"volume_id": "4adfb3fc-0236-45dc-a5b9-1e3c07a57b4b", "create_info": {"type": "qcow2", "new_file": "volume-4adfb3fc-0236-45dc-a5b9-1e3c07a57b4b.31925d82-2dd9-4516-b446-037362ae1cc8.vhdx", "snapshot_id": "31925d82-2dd9-4516-b446-037362ae1cc8"}}} {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:48:22.211895 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-b43e64d8-602b-48dd-99d5-a74bfa766ffa tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe6eb38e8df492daaef5755ddea7773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234f69f21d7a456a9ab6a86c4ac2ede2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:22.217723 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [req-7106e204-1fc7-42e0-b86b-0906fff6f69e req-fc18f2ac-2edd-4d39-820e-a04597085b05 admin admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2b15302a-f4a0-4e7f-8af3-7ee6eb916adf(cell1) {{(pid=127033) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 28 09:48:22.218175 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-7106e204-1fc7-42e0-b86b-0906fff6f69e req-fc18f2ac-2edd-4d39-820e-a04597085b05 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:22.218647 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-7106e204-1fc7-42e0-b86b-0906fff6f69e req-fc18f2ac-2edd-4d39-820e-a04597085b05 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:22.219068 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-7106e204-1fc7-42e0-b86b-0906fff6f69e req-fc18f2ac-2edd-4d39-820e-a04597085b05 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:22.219863 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-b43e64d8-602b-48dd-99d5-a74bfa766ffa tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] 10.222.0.52 "GET /compute/v2.1/servers/1eaf7cc8-63d3-40c6-b5f5-e4e978ddfe17" status: 200 len: 1510 microversion: 2.1 time: 0.156981 Oct 28 09:48:22.220530 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 135/281] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:48:22 2022] GET /compute/v2.1/servers/1eaf7cc8-63d3-40c6-b5f5-e4e978ddfe17 => generated 1510 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:48:22.225089 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-83193583-3c09-4a3a-ba8a-440adbcb4567 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:22.225644 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-83193583-3c09-4a3a-ba8a-440adbcb4567 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] [instance: 91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:22.231658 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-83193583-3c09-4a3a-ba8a-440adbcb4567 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:22.232237 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-83193583-3c09-4a3a-ba8a-440adbcb4567 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:22.232731 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-83193583-3c09-4a3a-ba8a-440adbcb4567 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:22.233473 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-83193583-3c09-4a3a-ba8a-440adbcb4567 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:22.233988 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-83193583-3c09-4a3a-ba8a-440adbcb4567 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:22.234486 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-83193583-3c09-4a3a-ba8a-440adbcb4567 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:22.256891 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-7106e204-1fc7-42e0-b86b-0906fff6f69e req-fc18f2ac-2edd-4d39-820e-a04597085b05 admin admin] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:22.257665 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-83193583-3c09-4a3a-ba8a-440adbcb4567 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] 10.222.0.52 "GET /compute/v2.1/servers/91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1/ips" status: 200 len: 145 microversion: 2.1 time: 0.035592 Oct 28 09:48:22.257880 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-7106e204-1fc7-42e0-b86b-0906fff6f69e req-fc18f2ac-2edd-4d39-820e-a04597085b05 admin admin] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:22.258241 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 136/282] 10.222.0.52 () {58 vars in 1248 bytes} [Fri Oct 28 09:48:22 2022] GET /compute/v2.1/servers/91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1/ips => generated 145 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:48:22.258432 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-7106e204-1fc7-42e0-b86b-0906fff6f69e req-fc18f2ac-2edd-4d39-820e-a04597085b05 admin admin] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:22.263988 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-d4361afb-33f3-45db-9715-7a93a8bf394d tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:22.264900 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-d4361afb-33f3-45db-9715-7a93a8bf394d tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] [instance: 0e97301c-3a01-452d-b54a-6bf66c4793d9] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:22.270644 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-d4361afb-33f3-45db-9715-7a93a8bf394d tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:22.271121 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-d4361afb-33f3-45db-9715-7a93a8bf394d tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:22.271540 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-d4361afb-33f3-45db-9715-7a93a8bf394d tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:22.272252 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-d4361afb-33f3-45db-9715-7a93a8bf394d tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:22.273316 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-d4361afb-33f3-45db-9715-7a93a8bf394d tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:22.273725 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-d4361afb-33f3-45db-9715-7a93a8bf394d tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:22.284965 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [req-7106e204-1fc7-42e0-b86b-0906fff6f69e req-fc18f2ac-2edd-4d39-820e-a04597085b05 admin admin] 10.222.0.58 "POST /compute/v2.1/os-assisted-volume-snapshots" status: 200 len: 78 microversion: 2.1 time: 0.131117 Oct 28 09:48:22.285547 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 147/283] 10.222.0.58 () {64 vars in 1326 bytes} [Fri Oct 28 09:48:22 2022] POST /compute/v2.1/os-assisted-volume-snapshots => generated 78 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 28 09:48:22.304638 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-d4361afb-33f3-45db-9715-7a93a8bf394d tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:22.305113 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-d4361afb-33f3-45db-9715-7a93a8bf394d tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:22.305538 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-d4361afb-33f3-45db-9715-7a93a8bf394d tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:22.306003 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.objects.instance [None req-d4361afb-33f3-45db-9715-7a93a8bf394d tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lazy-loading 'fault' on Instance uuid 0e97301c-3a01-452d-b54a-6bf66c4793d9 {{(pid=127032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:48:22.311675 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG dbcounter [-] [127032] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:48:22.351210 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-d4361afb-33f3-45db-9715-7a93a8bf394d tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c1b55b5c04ba380ed8ffdaa462bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa6bd99403b4421acb8bd714c9450c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:22.359114 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-d4361afb-33f3-45db-9715-7a93a8bf394d tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] 10.222.0.52 "GET /compute/v2.1/servers/0e97301c-3a01-452d-b54a-6bf66c4793d9" status: 200 len: 1304 microversion: 2.1 time: 0.098800 Oct 28 09:48:22.359687 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 137/284] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:48:22 2022] GET /compute/v2.1/servers/0e97301c-3a01-452d-b54a-6bf66c4793d9 => generated 1304 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:48:22.760526 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-a1acf008-e609-4d0b-8fb8-bee89f54cf75 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:22.761395 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-a1acf008-e609-4d0b-8fb8-bee89f54cf75 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] [instance: 7ab20f71-d81e-4b6a-90f0-e4b0873c0469] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:22.768336 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-a1acf008-e609-4d0b-8fb8-bee89f54cf75 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:22.768820 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-a1acf008-e609-4d0b-8fb8-bee89f54cf75 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:22.769262 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-a1acf008-e609-4d0b-8fb8-bee89f54cf75 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:22.769987 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-a1acf008-e609-4d0b-8fb8-bee89f54cf75 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:22.770446 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-a1acf008-e609-4d0b-8fb8-bee89f54cf75 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:22.770871 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-a1acf008-e609-4d0b-8fb8-bee89f54cf75 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:22.902730 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-a1acf008-e609-4d0b-8fb8-bee89f54cf75 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05718633def4ad6822728767580b810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89c15d74a584be3b5e44f74ed50eea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:22.910304 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-a1acf008-e609-4d0b-8fb8-bee89f54cf75 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] 10.222.0.52 "GET /compute/v2.1/servers/7ab20f71-d81e-4b6a-90f0-e4b0873c0469" status: 200 len: 1315 microversion: 2.1 time: 0.154925 Oct 28 09:48:22.910864 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 148/285] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:48:22 2022] GET /compute/v2.1/servers/7ab20f71-d81e-4b6a-90f0-e4b0873c0469 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:48:23.243291 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-fe84329a-328f-4ee1-8337-973e62fd1f70 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:23.243935 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-fe84329a-328f-4ee1-8337-973e62fd1f70 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: 1eaf7cc8-63d3-40c6-b5f5-e4e978ddfe17] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:23.250335 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-fe84329a-328f-4ee1-8337-973e62fd1f70 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:23.250821 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-fe84329a-328f-4ee1-8337-973e62fd1f70 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:23.251254 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-fe84329a-328f-4ee1-8337-973e62fd1f70 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:23.251974 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-fe84329a-328f-4ee1-8337-973e62fd1f70 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:23.252434 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-fe84329a-328f-4ee1-8337-973e62fd1f70 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:23.252864 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-fe84329a-328f-4ee1-8337-973e62fd1f70 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:23.380429 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-fe84329a-328f-4ee1-8337-973e62fd1f70 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe6eb38e8df492daaef5755ddea7773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234f69f21d7a456a9ab6a86c4ac2ede2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:23.383444 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-85283e3d-87d1-4cad-aa8f-0a40ff6edb53 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:23.384108 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-85283e3d-87d1-4cad-aa8f-0a40ff6edb53 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] [instance: 0e97301c-3a01-452d-b54a-6bf66c4793d9] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:23.388851 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-fe84329a-328f-4ee1-8337-973e62fd1f70 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] 10.222.0.52 "GET /compute/v2.1/servers/1eaf7cc8-63d3-40c6-b5f5-e4e978ddfe17" status: 200 len: 1510 microversion: 2.1 time: 0.149925 Oct 28 09:48:23.389532 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 138/286] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:48:23 2022] GET /compute/v2.1/servers/1eaf7cc8-63d3-40c6-b5f5-e4e978ddfe17 => generated 1510 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:48:23.390007 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-85283e3d-87d1-4cad-aa8f-0a40ff6edb53 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:23.390617 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-85283e3d-87d1-4cad-aa8f-0a40ff6edb53 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:23.391056 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-85283e3d-87d1-4cad-aa8f-0a40ff6edb53 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:23.391780 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-85283e3d-87d1-4cad-aa8f-0a40ff6edb53 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:23.392235 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-85283e3d-87d1-4cad-aa8f-0a40ff6edb53 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:23.392661 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-85283e3d-87d1-4cad-aa8f-0a40ff6edb53 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:23.423094 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-85283e3d-87d1-4cad-aa8f-0a40ff6edb53 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:23.423488 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-85283e3d-87d1-4cad-aa8f-0a40ff6edb53 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:23.423952 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-85283e3d-87d1-4cad-aa8f-0a40ff6edb53 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:23.424391 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.objects.instance [None req-85283e3d-87d1-4cad-aa8f-0a40ff6edb53 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lazy-loading 'fault' on Instance uuid 0e97301c-3a01-452d-b54a-6bf66c4793d9 {{(pid=127033) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:48:23.467929 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-85283e3d-87d1-4cad-aa8f-0a40ff6edb53 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c1b55b5c04ba380ed8ffdaa462bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa6bd99403b4421acb8bd714c9450c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:23.475447 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-85283e3d-87d1-4cad-aa8f-0a40ff6edb53 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] 10.222.0.52 "GET /compute/v2.1/servers/0e97301c-3a01-452d-b54a-6bf66c4793d9" status: 200 len: 1304 microversion: 2.1 time: 0.096569 Oct 28 09:48:23.476043 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 149/287] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:48:23 2022] GET /compute/v2.1/servers/0e97301c-3a01-452d-b54a-6bf66c4793d9 => generated 1304 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:48:23.944110 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-b273d1ce-c0ad-4e2a-adc7-33ac6ff5a934 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:23.944110 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-b273d1ce-c0ad-4e2a-adc7-33ac6ff5a934 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] [instance: 7ab20f71-d81e-4b6a-90f0-e4b0873c0469] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:23.944110 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-b273d1ce-c0ad-4e2a-adc7-33ac6ff5a934 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:23.944110 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-b273d1ce-c0ad-4e2a-adc7-33ac6ff5a934 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:23.945060 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-b273d1ce-c0ad-4e2a-adc7-33ac6ff5a934 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:23.945060 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-b273d1ce-c0ad-4e2a-adc7-33ac6ff5a934 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:23.945060 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-b273d1ce-c0ad-4e2a-adc7-33ac6ff5a934 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:23.945060 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-b273d1ce-c0ad-4e2a-adc7-33ac6ff5a934 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:24.097433 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-b273d1ce-c0ad-4e2a-adc7-33ac6ff5a934 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05718633def4ad6822728767580b810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89c15d74a584be3b5e44f74ed50eea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:24.105140 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-b273d1ce-c0ad-4e2a-adc7-33ac6ff5a934 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] 10.222.0.52 "GET /compute/v2.1/servers/7ab20f71-d81e-4b6a-90f0-e4b0873c0469" status: 200 len: 1315 microversion: 2.1 time: 0.174835 Oct 28 09:48:24.105705 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 139/288] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:48:23 2022] GET /compute/v2.1/servers/7ab20f71-d81e-4b6a-90f0-e4b0873c0469 => generated 1315 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:48:24.411313 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-3058642a-5564-4fbf-a0fe-1dfbe55bc997 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:24.411966 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-3058642a-5564-4fbf-a0fe-1dfbe55bc997 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: 1eaf7cc8-63d3-40c6-b5f5-e4e978ddfe17] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:24.419017 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-3058642a-5564-4fbf-a0fe-1dfbe55bc997 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:24.419508 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-3058642a-5564-4fbf-a0fe-1dfbe55bc997 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:24.420138 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-3058642a-5564-4fbf-a0fe-1dfbe55bc997 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:24.420839 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-3058642a-5564-4fbf-a0fe-1dfbe55bc997 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:24.421297 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-3058642a-5564-4fbf-a0fe-1dfbe55bc997 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:24.421723 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-3058642a-5564-4fbf-a0fe-1dfbe55bc997 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:24.498678 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-970413c2-8d67-4896-a6b2-e80ed907753e tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:24.499656 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-970413c2-8d67-4896-a6b2-e80ed907753e tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] [instance: 0e97301c-3a01-452d-b54a-6bf66c4793d9] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:24.505817 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-970413c2-8d67-4896-a6b2-e80ed907753e tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:24.506298 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-970413c2-8d67-4896-a6b2-e80ed907753e tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:24.506752 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-970413c2-8d67-4896-a6b2-e80ed907753e tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:24.507771 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-970413c2-8d67-4896-a6b2-e80ed907753e tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:24.508218 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-970413c2-8d67-4896-a6b2-e80ed907753e tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:24.508634 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-970413c2-8d67-4896-a6b2-e80ed907753e tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:24.541830 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-970413c2-8d67-4896-a6b2-e80ed907753e tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:24.542305 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-970413c2-8d67-4896-a6b2-e80ed907753e tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:24.542794 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-970413c2-8d67-4896-a6b2-e80ed907753e tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:24.543194 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.objects.instance [None req-970413c2-8d67-4896-a6b2-e80ed907753e tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lazy-loading 'fault' on Instance uuid 0e97301c-3a01-452d-b54a-6bf66c4793d9 {{(pid=127032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:48:24.552917 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-3058642a-5564-4fbf-a0fe-1dfbe55bc997 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe6eb38e8df492daaef5755ddea7773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234f69f21d7a456a9ab6a86c4ac2ede2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:24.561435 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-3058642a-5564-4fbf-a0fe-1dfbe55bc997 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] 10.222.0.52 "GET /compute/v2.1/servers/1eaf7cc8-63d3-40c6-b5f5-e4e978ddfe17" status: 200 len: 1510 microversion: 2.1 time: 0.154021 Oct 28 09:48:24.562025 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 150/289] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:48:24 2022] GET /compute/v2.1/servers/1eaf7cc8-63d3-40c6-b5f5-e4e978ddfe17 => generated 1510 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:48:24.587161 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-970413c2-8d67-4896-a6b2-e80ed907753e tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c1b55b5c04ba380ed8ffdaa462bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa6bd99403b4421acb8bd714c9450c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:24.594794 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-970413c2-8d67-4896-a6b2-e80ed907753e tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] 10.222.0.52 "GET /compute/v2.1/servers/0e97301c-3a01-452d-b54a-6bf66c4793d9" status: 200 len: 1304 microversion: 2.1 time: 0.099934 Oct 28 09:48:24.595354 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 140/290] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:48:24 2022] GET /compute/v2.1/servers/0e97301c-3a01-452d-b54a-6bf66c4793d9 => generated 1304 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:48:25.068067 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-24611269-80c6-48f2-b7ae-941af056efd7 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "012eec24-1204-4f92-975f-b199759c950b"}} {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:48:25.071021 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-24611269-80c6-48f2-b7ae-941af056efd7 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] [instance: 91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:25.076879 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-24611269-80c6-48f2-b7ae-941af056efd7 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:25.077361 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-24611269-80c6-48f2-b7ae-941af056efd7 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:25.077790 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-24611269-80c6-48f2-b7ae-941af056efd7 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:25.078478 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-24611269-80c6-48f2-b7ae-941af056efd7 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:25.078937 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-24611269-80c6-48f2-b7ae-941af056efd7 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:25.079355 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-24611269-80c6-48f2-b7ae-941af056efd7 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:25.128042 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-20f6a0b5-9b7c-4df9-9429-98bfe7e428b3 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:25.128646 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-20f6a0b5-9b7c-4df9-9429-98bfe7e428b3 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] [instance: 7ab20f71-d81e-4b6a-90f0-e4b0873c0469] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:25.135225 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-20f6a0b5-9b7c-4df9-9429-98bfe7e428b3 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:25.135708 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-20f6a0b5-9b7c-4df9-9429-98bfe7e428b3 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:25.136166 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-20f6a0b5-9b7c-4df9-9429-98bfe7e428b3 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:25.136857 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-20f6a0b5-9b7c-4df9-9429-98bfe7e428b3 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:25.137303 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-20f6a0b5-9b7c-4df9-9429-98bfe7e428b3 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:25.137905 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-20f6a0b5-9b7c-4df9-9429-98bfe7e428b3 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:25.269928 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-20f6a0b5-9b7c-4df9-9429-98bfe7e428b3 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05718633def4ad6822728767580b810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89c15d74a584be3b5e44f74ed50eea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:25.278237 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-20f6a0b5-9b7c-4df9-9429-98bfe7e428b3 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] 10.222.0.52 "GET /compute/v2.1/servers/7ab20f71-d81e-4b6a-90f0-e4b0873c0469" status: 200 len: 1315 microversion: 2.1 time: 0.154013 Oct 28 09:48:25.278815 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 141/291] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:48:25 2022] GET /compute/v2.1/servers/7ab20f71-d81e-4b6a-90f0-e4b0873c0469 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:48:25.585097 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-2dfb83ea-57dc-480e-86f2-512e4b8dec4e tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:25.585709 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-2dfb83ea-57dc-480e-86f2-512e4b8dec4e tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: 1eaf7cc8-63d3-40c6-b5f5-e4e978ddfe17] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:25.592108 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-2dfb83ea-57dc-480e-86f2-512e4b8dec4e tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:25.592599 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-2dfb83ea-57dc-480e-86f2-512e4b8dec4e tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:25.593031 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-2dfb83ea-57dc-480e-86f2-512e4b8dec4e tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:25.593718 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-2dfb83ea-57dc-480e-86f2-512e4b8dec4e tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:25.594176 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-2dfb83ea-57dc-480e-86f2-512e4b8dec4e tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:25.594599 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-2dfb83ea-57dc-480e-86f2-512e4b8dec4e tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:25.724271 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-2dfb83ea-57dc-480e-86f2-512e4b8dec4e tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe6eb38e8df492daaef5755ddea7773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234f69f21d7a456a9ab6a86c4ac2ede2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:25.732219 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-2dfb83ea-57dc-480e-86f2-512e4b8dec4e tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] 10.222.0.52 "GET /compute/v2.1/servers/1eaf7cc8-63d3-40c6-b5f5-e4e978ddfe17" status: 200 len: 1510 microversion: 2.1 time: 0.151097 Oct 28 09:48:25.732785 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 142/292] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:48:25 2022] GET /compute/v2.1/servers/1eaf7cc8-63d3-40c6-b5f5-e4e978ddfe17 => generated 1510 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:48:25.737203 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-d6a26969-b1f8-4939-a0d3-e644bf681cfc tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:25.737831 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-d6a26969-b1f8-4939-a0d3-e644bf681cfc tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] [instance: 0e97301c-3a01-452d-b54a-6bf66c4793d9] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:25.743721 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-d6a26969-b1f8-4939-a0d3-e644bf681cfc tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:25.744294 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-d6a26969-b1f8-4939-a0d3-e644bf681cfc tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:25.744728 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-d6a26969-b1f8-4939-a0d3-e644bf681cfc tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:25.745404 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-d6a26969-b1f8-4939-a0d3-e644bf681cfc tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:25.745855 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-d6a26969-b1f8-4939-a0d3-e644bf681cfc tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:25.746272 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-d6a26969-b1f8-4939-a0d3-e644bf681cfc tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:25.777010 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-d6a26969-b1f8-4939-a0d3-e644bf681cfc tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:25.777486 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-d6a26969-b1f8-4939-a0d3-e644bf681cfc tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:25.777912 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-d6a26969-b1f8-4939-a0d3-e644bf681cfc tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:25.778366 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.objects.instance [None req-d6a26969-b1f8-4939-a0d3-e644bf681cfc tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lazy-loading 'fault' on Instance uuid 0e97301c-3a01-452d-b54a-6bf66c4793d9 {{(pid=127032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:48:25.822368 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-d6a26969-b1f8-4939-a0d3-e644bf681cfc tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c1b55b5c04ba380ed8ffdaa462bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa6bd99403b4421acb8bd714c9450c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:25.829979 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-d6a26969-b1f8-4939-a0d3-e644bf681cfc tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] 10.222.0.52 "GET /compute/v2.1/servers/0e97301c-3a01-452d-b54a-6bf66c4793d9" status: 200 len: 1304 microversion: 2.1 time: 0.096269 Oct 28 09:48:25.830558 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 143/293] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:48:25 2022] GET /compute/v2.1/servers/0e97301c-3a01-452d-b54a-6bf66c4793d9 => generated 1304 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:48:26.198843 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-1ab34e75-e1a9-458f-a77b-215f62ffb349 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:26.199330 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-1ab34e75-e1a9-458f-a77b-215f62ffb349 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 6869ffb6-ce4f-4a91-b8d9-7765ea56e95a] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:26.205685 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-1ab34e75-e1a9-458f-a77b-215f62ffb349 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:26.206064 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-1ab34e75-e1a9-458f-a77b-215f62ffb349 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:26.206560 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-1ab34e75-e1a9-458f-a77b-215f62ffb349 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:26.207340 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-1ab34e75-e1a9-458f-a77b-215f62ffb349 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:26.207868 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-1ab34e75-e1a9-458f-a77b-215f62ffb349 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:26.208397 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-1ab34e75-e1a9-458f-a77b-215f62ffb349 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:26.234293 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-1ab34e75-e1a9-458f-a77b-215f62ffb349 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a/ips" status: 200 len: 150 microversion: 2.20 time: 0.039176 Oct 28 09:48:26.234864 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 144/294] 10.222.0.52 () {60 vars in 1289 bytes} [Fri Oct 28 09:48:26 2022] GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a/ips => generated 150 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 09:48:26.302276 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-5aba85ce-9b86-4fb8-895e-a687c004157c tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:26.302945 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-5aba85ce-9b86-4fb8-895e-a687c004157c tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] [instance: 7ab20f71-d81e-4b6a-90f0-e4b0873c0469] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:26.310571 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-5aba85ce-9b86-4fb8-895e-a687c004157c tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:26.311071 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-5aba85ce-9b86-4fb8-895e-a687c004157c tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:26.311507 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-5aba85ce-9b86-4fb8-895e-a687c004157c tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:26.312267 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-5aba85ce-9b86-4fb8-895e-a687c004157c tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:26.312729 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-5aba85ce-9b86-4fb8-895e-a687c004157c tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:26.313153 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-5aba85ce-9b86-4fb8-895e-a687c004157c tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:26.408690 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG dbcounter [-] [127032] Writing DB stats nova_cell0:SELECT=2 {{(pid=127032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:48:26.459092 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-5aba85ce-9b86-4fb8-895e-a687c004157c tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05718633def4ad6822728767580b810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89c15d74a584be3b5e44f74ed50eea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:26.467638 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-5aba85ce-9b86-4fb8-895e-a687c004157c tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] 10.222.0.52 "GET /compute/v2.1/servers/7ab20f71-d81e-4b6a-90f0-e4b0873c0469" status: 200 len: 1315 microversion: 2.1 time: 0.169608 Oct 28 09:48:26.468227 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 145/295] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:48:26 2022] GET /compute/v2.1/servers/7ab20f71-d81e-4b6a-90f0-e4b0873c0469 => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:48:26.472907 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [req-a77b51a7-c7bf-48c0-9782-ff729a4dae5f req-bf116f74-aec1-4299-b090-c0733b7c7a1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ab20f71-d81e-4b6a-90f0-e4b0873c0469", "name": "network-vif-plugged", "status": "completed", "tag": "71eb0d61-47d4-42f9-ac21-8a556e555dae"}]} {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:48:26.483199 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-a77b51a7-c7bf-48c0-9782-ff729a4dae5f req-bf116f74-aec1-4299-b090-c0733b7c7a1a service nova] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:26.483842 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-a77b51a7-c7bf-48c0-9782-ff729a4dae5f req-bf116f74-aec1-4299-b090-c0733b7c7a1a service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:26.484276 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-a77b51a7-c7bf-48c0-9782-ff729a4dae5f req-bf116f74-aec1-4299-b090-c0733b7c7a1a service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:26.496770 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.compute.server_external_events [req-a77b51a7-c7bf-48c0-9782-ff729a4dae5f req-bf116f74-aec1-4299-b090-c0733b7c7a1a service nova] Creating event network-vif-plugged:71eb0d61-47d4-42f9-ac21-8a556e555dae for instance 7ab20f71-d81e-4b6a-90f0-e4b0873c0469 on hv-cinder-zed-3 Oct 28 09:48:26.501912 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [req-a77b51a7-c7bf-48c0-9782-ff729a4dae5f req-bf116f74-aec1-4299-b090-c0733b7c7a1a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032504 Oct 28 09:48:26.502726 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 146/296] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Oct 28 09:48:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:48:26.757211 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-7ea7a321-319e-4278-8b39-85daf95002c5 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:26.758353 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-7ea7a321-319e-4278-8b39-85daf95002c5 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: 1eaf7cc8-63d3-40c6-b5f5-e4e978ddfe17] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:26.764427 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-7ea7a321-319e-4278-8b39-85daf95002c5 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:26.764912 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-7ea7a321-319e-4278-8b39-85daf95002c5 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:26.765341 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-7ea7a321-319e-4278-8b39-85daf95002c5 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:26.766054 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-7ea7a321-319e-4278-8b39-85daf95002c5 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:26.766512 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-7ea7a321-319e-4278-8b39-85daf95002c5 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:26.766932 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-7ea7a321-319e-4278-8b39-85daf95002c5 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:26.901827 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-7ea7a321-319e-4278-8b39-85daf95002c5 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe6eb38e8df492daaef5755ddea7773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234f69f21d7a456a9ab6a86c4ac2ede2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:26.909816 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-7ea7a321-319e-4278-8b39-85daf95002c5 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] 10.222.0.52 "GET /compute/v2.1/servers/1eaf7cc8-63d3-40c6-b5f5-e4e978ddfe17" status: 200 len: 1510 microversion: 2.1 time: 0.157387 Oct 28 09:48:26.910396 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 147/297] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:48:26 2022] GET /compute/v2.1/servers/1eaf7cc8-63d3-40c6-b5f5-e4e978ddfe17 => generated 1510 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:48:26.915529 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-2e44e1e0-b763-43c2-acf4-84f5cd49774e tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:26.916367 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-2e44e1e0-b763-43c2-acf4-84f5cd49774e tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] [instance: 0e97301c-3a01-452d-b54a-6bf66c4793d9] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:26.922461 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-2e44e1e0-b763-43c2-acf4-84f5cd49774e tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:26.922939 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-2e44e1e0-b763-43c2-acf4-84f5cd49774e tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:26.923363 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-2e44e1e0-b763-43c2-acf4-84f5cd49774e tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:26.924081 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-2e44e1e0-b763-43c2-acf4-84f5cd49774e tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:26.924523 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-2e44e1e0-b763-43c2-acf4-84f5cd49774e tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:26.924931 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-2e44e1e0-b763-43c2-acf4-84f5cd49774e tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:26.954398 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-2e44e1e0-b763-43c2-acf4-84f5cd49774e tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:26.954864 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-2e44e1e0-b763-43c2-acf4-84f5cd49774e tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:26.955288 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-2e44e1e0-b763-43c2-acf4-84f5cd49774e tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:26.955724 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.objects.instance [None req-2e44e1e0-b763-43c2-acf4-84f5cd49774e tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lazy-loading 'fault' on Instance uuid 0e97301c-3a01-452d-b54a-6bf66c4793d9 {{(pid=127032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:48:27.000280 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-2e44e1e0-b763-43c2-acf4-84f5cd49774e tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c1b55b5c04ba380ed8ffdaa462bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa6bd99403b4421acb8bd714c9450c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:27.008074 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-2e44e1e0-b763-43c2-acf4-84f5cd49774e tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] 10.222.0.52 "GET /compute/v2.1/servers/0e97301c-3a01-452d-b54a-6bf66c4793d9" status: 200 len: 1304 microversion: 2.1 time: 0.096494 Oct 28 09:48:27.008560 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 148/298] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:48:26 2022] GET /compute/v2.1/servers/0e97301c-3a01-452d-b54a-6bf66c4793d9 => generated 1304 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:48:27.492374 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-80665bc5-9872-492d-8b2a-e226b5ba8dea tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:27.492970 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-80665bc5-9872-492d-8b2a-e226b5ba8dea tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] [instance: 7ab20f71-d81e-4b6a-90f0-e4b0873c0469] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:27.499070 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-80665bc5-9872-492d-8b2a-e226b5ba8dea tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:27.499558 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-80665bc5-9872-492d-8b2a-e226b5ba8dea tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:27.500035 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-80665bc5-9872-492d-8b2a-e226b5ba8dea tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:27.500725 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-80665bc5-9872-492d-8b2a-e226b5ba8dea tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:27.501179 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-80665bc5-9872-492d-8b2a-e226b5ba8dea tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:27.501600 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-80665bc5-9872-492d-8b2a-e226b5ba8dea tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:27.640701 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-80665bc5-9872-492d-8b2a-e226b5ba8dea tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05718633def4ad6822728767580b810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89c15d74a584be3b5e44f74ed50eea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:27.648389 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-80665bc5-9872-492d-8b2a-e226b5ba8dea tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] 10.222.0.52 "GET /compute/v2.1/servers/7ab20f71-d81e-4b6a-90f0-e4b0873c0469" status: 200 len: 1315 microversion: 2.1 time: 0.159976 Oct 28 09:48:27.649230 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 149/299] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:48:27 2022] GET /compute/v2.1/servers/7ab20f71-d81e-4b6a-90f0-e4b0873c0469 => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:48:27.933966 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-9bc1874c-cee2-4335-bfa7-58a5ade6f34f tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:27.934608 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-9bc1874c-cee2-4335-bfa7-58a5ade6f34f tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: 1eaf7cc8-63d3-40c6-b5f5-e4e978ddfe17] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:27.940968 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-9bc1874c-cee2-4335-bfa7-58a5ade6f34f tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:27.941451 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-9bc1874c-cee2-4335-bfa7-58a5ade6f34f tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:27.941888 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-9bc1874c-cee2-4335-bfa7-58a5ade6f34f tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:27.942580 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-9bc1874c-cee2-4335-bfa7-58a5ade6f34f tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:27.943032 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-9bc1874c-cee2-4335-bfa7-58a5ade6f34f tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:27.943456 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-9bc1874c-cee2-4335-bfa7-58a5ade6f34f tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:28.072640 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-9bc1874c-cee2-4335-bfa7-58a5ade6f34f tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe6eb38e8df492daaef5755ddea7773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234f69f21d7a456a9ab6a86c4ac2ede2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:28.080534 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-9bc1874c-cee2-4335-bfa7-58a5ade6f34f tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] 10.222.0.52 "GET /compute/v2.1/servers/1eaf7cc8-63d3-40c6-b5f5-e4e978ddfe17" status: 200 len: 1510 microversion: 2.1 time: 0.151001 Oct 28 09:48:28.081091 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 150/300] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:48:27 2022] GET /compute/v2.1/servers/1eaf7cc8-63d3-40c6-b5f5-e4e978ddfe17 => generated 1510 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:48:28.085455 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-fda6edec-ebcc-44fb-a419-94d650aeb32f tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:28.086053 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-fda6edec-ebcc-44fb-a419-94d650aeb32f tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] [instance: 0e97301c-3a01-452d-b54a-6bf66c4793d9] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:28.091766 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-fda6edec-ebcc-44fb-a419-94d650aeb32f tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:28.092261 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-fda6edec-ebcc-44fb-a419-94d650aeb32f tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:28.092693 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-fda6edec-ebcc-44fb-a419-94d650aeb32f tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:28.093384 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-fda6edec-ebcc-44fb-a419-94d650aeb32f tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:28.093836 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-fda6edec-ebcc-44fb-a419-94d650aeb32f tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:28.094262 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-fda6edec-ebcc-44fb-a419-94d650aeb32f tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:28.125807 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-fda6edec-ebcc-44fb-a419-94d650aeb32f tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:28.126348 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-fda6edec-ebcc-44fb-a419-94d650aeb32f tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:28.126780 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-fda6edec-ebcc-44fb-a419-94d650aeb32f tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:28.127256 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.objects.instance [None req-fda6edec-ebcc-44fb-a419-94d650aeb32f tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lazy-loading 'fault' on Instance uuid 0e97301c-3a01-452d-b54a-6bf66c4793d9 {{(pid=127032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:48:28.172844 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-fda6edec-ebcc-44fb-a419-94d650aeb32f tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c1b55b5c04ba380ed8ffdaa462bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa6bd99403b4421acb8bd714c9450c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:28.181074 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-fda6edec-ebcc-44fb-a419-94d650aeb32f tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] 10.222.0.52 "GET /compute/v2.1/servers/0e97301c-3a01-452d-b54a-6bf66c4793d9" status: 200 len: 1304 microversion: 2.1 time: 0.099047 Oct 28 09:48:28.181635 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 151/301] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:48:28 2022] GET /compute/v2.1/servers/0e97301c-3a01-452d-b54a-6bf66c4793d9 => generated 1304 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:48:28.260016 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-07c10fcd-1e9c-4b68-ba39-a2cff5195e99 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:48:28.260489 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-07c10fcd-1e9c-4b68-ba39-a2cff5195e99 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 6869ffb6-ce4f-4a91-b8d9-7765ea56e95a] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:28.266417 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-07c10fcd-1e9c-4b68-ba39-a2cff5195e99 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:28.266892 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-07c10fcd-1e9c-4b68-ba39-a2cff5195e99 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:28.267319 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-07c10fcd-1e9c-4b68-ba39-a2cff5195e99 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:28.268025 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-07c10fcd-1e9c-4b68-ba39-a2cff5195e99 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:28.268479 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-07c10fcd-1e9c-4b68-ba39-a2cff5195e99 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:28.268895 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-07c10fcd-1e9c-4b68-ba39-a2cff5195e99 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:28.291418 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.objects.instance [None req-07c10fcd-1e9c-4b68-ba39-a2cff5195e99 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lazy-loading 'flavor' on Instance uuid 6869ffb6-ce4f-4a91-b8d9-7765ea56e95a {{(pid=127032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:48:28.335405 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG dbcounter [-] [127032] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=127032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:48:28.504896 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-07c10fcd-1e9c-4b68-ba39-a2cff5195e99 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "POST /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a/action" status: 202 len: 0 microversion: 2.20 time: 0.248377 Oct 28 09:48:28.506011 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 152/302] 10.222.0.52 () {62 vars in 1319 bytes} [Fri Oct 28 09:48:28 2022] POST /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a/action => generated 0 bytes in 251 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 28 09:48:28.518499 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-d2aef710-8146-4bd2-b0f5-77afb9b6af89 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:28.519201 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-d2aef710-8146-4bd2-b0f5-77afb9b6af89 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 6869ffb6-ce4f-4a91-b8d9-7765ea56e95a] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:28.536267 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-d2aef710-8146-4bd2-b0f5-77afb9b6af89 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:28.536760 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-d2aef710-8146-4bd2-b0f5-77afb9b6af89 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:28.537190 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-d2aef710-8146-4bd2-b0f5-77afb9b6af89 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:28.537911 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-d2aef710-8146-4bd2-b0f5-77afb9b6af89 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:28.538345 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-d2aef710-8146-4bd2-b0f5-77afb9b6af89 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:28.538953 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-d2aef710-8146-4bd2-b0f5-77afb9b6af89 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:28.684546 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-d2aef710-8146-4bd2-b0f5-77afb9b6af89 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:28.692950 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-d2aef710-8146-4bd2-b0f5-77afb9b6af89 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:28.694402 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-d2aef710-8146-4bd2-b0f5-77afb9b6af89 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:28.695574 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-d2aef710-8146-4bd2-b0f5-77afb9b6af89 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a" status: 200 len: 1720 microversion: 2.20 time: 0.181720 Oct 28 09:48:28.696815 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 153/303] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:48:28 2022] GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a => generated 1720 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:48:28.701328 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-ae28f58a-1b38-41ff-99bc-80249fbff585 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:28.701929 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-ae28f58a-1b38-41ff-99bc-80249fbff585 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] [instance: 7ab20f71-d81e-4b6a-90f0-e4b0873c0469] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:28.708319 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ae28f58a-1b38-41ff-99bc-80249fbff585 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:28.708815 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ae28f58a-1b38-41ff-99bc-80249fbff585 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:28.709256 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ae28f58a-1b38-41ff-99bc-80249fbff585 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:28.709964 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ae28f58a-1b38-41ff-99bc-80249fbff585 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:28.710424 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ae28f58a-1b38-41ff-99bc-80249fbff585 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:28.710848 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ae28f58a-1b38-41ff-99bc-80249fbff585 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:28.844140 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-ae28f58a-1b38-41ff-99bc-80249fbff585 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05718633def4ad6822728767580b810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89c15d74a584be3b5e44f74ed50eea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:28.851874 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-ae28f58a-1b38-41ff-99bc-80249fbff585 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] 10.222.0.52 "GET /compute/v2.1/servers/7ab20f71-d81e-4b6a-90f0-e4b0873c0469" status: 200 len: 1315 microversion: 2.1 time: 0.154079 Oct 28 09:48:28.852956 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 154/304] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:48:28 2022] GET /compute/v2.1/servers/7ab20f71-d81e-4b6a-90f0-e4b0873c0469 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:48:29.104712 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-f95056bf-4f71-419c-818b-18c4d64178e2 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:29.105524 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-f95056bf-4f71-419c-818b-18c4d64178e2 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: 1eaf7cc8-63d3-40c6-b5f5-e4e978ddfe17] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:29.113364 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-f95056bf-4f71-419c-818b-18c4d64178e2 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:29.114014 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-f95056bf-4f71-419c-818b-18c4d64178e2 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:29.114462 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-f95056bf-4f71-419c-818b-18c4d64178e2 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:29.115176 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-f95056bf-4f71-419c-818b-18c4d64178e2 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:29.115650 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-f95056bf-4f71-419c-818b-18c4d64178e2 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:29.116180 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-f95056bf-4f71-419c-818b-18c4d64178e2 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:29.120716 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-24611269-80c6-48f2-b7ae-941af056efd7 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] 10.222.0.52 "POST /compute/v2.1/servers/91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.056390 Oct 28 09:48:29.121890 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 151/305] 10.222.0.52 () {60 vars in 1323 bytes} [Fri Oct 28 09:48:25 2022] POST /compute/v2.1/servers/91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1/os-volume_attachments => generated 194 bytes in 4059 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:48:29.204658 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-a6b9a625-f98b-4e39-854e-a16eb3f98c06 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:29.205907 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-a6b9a625-f98b-4e39-854e-a16eb3f98c06 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] [instance: 0e97301c-3a01-452d-b54a-6bf66c4793d9] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:29.213534 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-a6b9a625-f98b-4e39-854e-a16eb3f98c06 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:29.214501 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-a6b9a625-f98b-4e39-854e-a16eb3f98c06 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:29.215098 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-a6b9a625-f98b-4e39-854e-a16eb3f98c06 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:29.215821 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-a6b9a625-f98b-4e39-854e-a16eb3f98c06 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:29.216667 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-a6b9a625-f98b-4e39-854e-a16eb3f98c06 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:29.217167 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-a6b9a625-f98b-4e39-854e-a16eb3f98c06 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:29.233794 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG dbcounter [-] [127033] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:48:29.255105 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-a6b9a625-f98b-4e39-854e-a16eb3f98c06 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:29.255595 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-a6b9a625-f98b-4e39-854e-a16eb3f98c06 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:29.256235 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-a6b9a625-f98b-4e39-854e-a16eb3f98c06 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:29.256688 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.objects.instance [None req-a6b9a625-f98b-4e39-854e-a16eb3f98c06 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lazy-loading 'fault' on Instance uuid 0e97301c-3a01-452d-b54a-6bf66c4793d9 {{(pid=127033) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:48:29.265464 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-f95056bf-4f71-419c-818b-18c4d64178e2 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe6eb38e8df492daaef5755ddea7773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234f69f21d7a456a9ab6a86c4ac2ede2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:29.275495 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-f95056bf-4f71-419c-818b-18c4d64178e2 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] 10.222.0.52 "GET /compute/v2.1/servers/1eaf7cc8-63d3-40c6-b5f5-e4e978ddfe17" status: 200 len: 1516 microversion: 2.1 time: 0.175249 Oct 28 09:48:29.283793 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 155/306] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:48:29 2022] GET /compute/v2.1/servers/1eaf7cc8-63d3-40c6-b5f5-e4e978ddfe17 => generated 1516 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:48:29.305985 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-a6b9a625-f98b-4e39-854e-a16eb3f98c06 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c1b55b5c04ba380ed8ffdaa462bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa6bd99403b4421acb8bd714c9450c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:29.313955 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-a6b9a625-f98b-4e39-854e-a16eb3f98c06 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] 10.222.0.52 "GET /compute/v2.1/servers/0e97301c-3a01-452d-b54a-6bf66c4793d9" status: 200 len: 1304 microversion: 2.1 time: 0.114050 Oct 28 09:48:29.314530 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 152/307] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:48:29 2022] GET /compute/v2.1/servers/0e97301c-3a01-452d-b54a-6bf66c4793d9 => generated 1304 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:48:29.722702 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-06b8fce8-112d-4d36-9f2a-200057b18b9c tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:29.723600 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-06b8fce8-112d-4d36-9f2a-200057b18b9c tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 6869ffb6-ce4f-4a91-b8d9-7765ea56e95a] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:29.730107 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-06b8fce8-112d-4d36-9f2a-200057b18b9c tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:29.730564 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-06b8fce8-112d-4d36-9f2a-200057b18b9c tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:29.730995 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-06b8fce8-112d-4d36-9f2a-200057b18b9c tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:29.731968 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-06b8fce8-112d-4d36-9f2a-200057b18b9c tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:29.732418 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-06b8fce8-112d-4d36-9f2a-200057b18b9c tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:29.732830 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-06b8fce8-112d-4d36-9f2a-200057b18b9c tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:29.875528 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-cc5cbb29-273c-409e-b3a6-3ae0e392a1fc tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:29.875796 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-06b8fce8-112d-4d36-9f2a-200057b18b9c tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:29.876748 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-cc5cbb29-273c-409e-b3a6-3ae0e392a1fc tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] [instance: 7ab20f71-d81e-4b6a-90f0-e4b0873c0469] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:29.885415 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-06b8fce8-112d-4d36-9f2a-200057b18b9c tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:29.886853 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-06b8fce8-112d-4d36-9f2a-200057b18b9c tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:29.895866 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-06b8fce8-112d-4d36-9f2a-200057b18b9c tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a" status: 200 len: 1720 microversion: 2.20 time: 0.169546 Oct 28 09:48:29.895866 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 156/308] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:48:29 2022] GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a => generated 1720 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:48:29.896227 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-cc5cbb29-273c-409e-b3a6-3ae0e392a1fc tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:29.896227 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-cc5cbb29-273c-409e-b3a6-3ae0e392a1fc tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:29.896227 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-cc5cbb29-273c-409e-b3a6-3ae0e392a1fc tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:29.896227 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-cc5cbb29-273c-409e-b3a6-3ae0e392a1fc tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:29.896732 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-cc5cbb29-273c-409e-b3a6-3ae0e392a1fc tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:29.896732 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-cc5cbb29-273c-409e-b3a6-3ae0e392a1fc tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:30.046314 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-cc5cbb29-273c-409e-b3a6-3ae0e392a1fc tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05718633def4ad6822728767580b810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89c15d74a584be3b5e44f74ed50eea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:30.054296 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-cc5cbb29-273c-409e-b3a6-3ae0e392a1fc tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] 10.222.0.52 "GET /compute/v2.1/servers/7ab20f71-d81e-4b6a-90f0-e4b0873c0469" status: 200 len: 1315 microversion: 2.1 time: 0.182552 Oct 28 09:48:30.054884 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 153/309] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:48:29 2022] GET /compute/v2.1/servers/7ab20f71-d81e-4b6a-90f0-e4b0873c0469 => generated 1315 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:48:30.337275 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-4b70b592-5bee-427e-a4d6-18be4b92108c tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:30.337877 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-4b70b592-5bee-427e-a4d6-18be4b92108c tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] [instance: 0e97301c-3a01-452d-b54a-6bf66c4793d9] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:30.340321 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG dbcounter [-] [127032] Writing DB stats nova_api:SELECT=100 {{(pid=127032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:48:30.345872 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-4b70b592-5bee-427e-a4d6-18be4b92108c tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:30.346353 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-4b70b592-5bee-427e-a4d6-18be4b92108c tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:30.346781 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-4b70b592-5bee-427e-a4d6-18be4b92108c tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:30.347470 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-4b70b592-5bee-427e-a4d6-18be4b92108c tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:30.347978 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-4b70b592-5bee-427e-a4d6-18be4b92108c tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:30.348396 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-4b70b592-5bee-427e-a4d6-18be4b92108c tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:30.381741 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-4b70b592-5bee-427e-a4d6-18be4b92108c tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:30.382191 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-4b70b592-5bee-427e-a4d6-18be4b92108c tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:30.382805 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-4b70b592-5bee-427e-a4d6-18be4b92108c tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:30.383345 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.objects.instance [None req-4b70b592-5bee-427e-a4d6-18be4b92108c tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lazy-loading 'fault' on Instance uuid 0e97301c-3a01-452d-b54a-6bf66c4793d9 {{(pid=127032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:48:30.447923 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-4b70b592-5bee-427e-a4d6-18be4b92108c tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c1b55b5c04ba380ed8ffdaa462bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa6bd99403b4421acb8bd714c9450c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:30.457503 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-4b70b592-5bee-427e-a4d6-18be4b92108c tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] 10.222.0.52 "GET /compute/v2.1/servers/0e97301c-3a01-452d-b54a-6bf66c4793d9" status: 200 len: 1304 microversion: 2.1 time: 0.123559 Oct 28 09:48:30.457503 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 157/310] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:48:30 2022] GET /compute/v2.1/servers/0e97301c-3a01-452d-b54a-6bf66c4793d9 => generated 1304 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:48:30.638742 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-b1ee72c4-eecc-45ac-97e5-1b04633711f8 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Action: 'create', calling method: .version_select at 0x7ff01031cb80>, body: {"keypair": {"name": "tempest-keypair-1499224246", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCXDOGJv3vD0+bhxB3wgrLcdC0HT5Yg3VjqGqgVKGeskVJgD/yMotqRAibx4NWJjpTXj7AqGHlT+SbYMThE3qZB9F1iOLN52cwetXzfkDyVCKtN6Zcykkd0nSgURrQ+0/w=="}} {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:48:30.644809 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG dbcounter [-] [127033] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:48:30.658413 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.quota [None req-b1ee72c4-eecc-45ac-97e5-1b04633711f8 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Getting quotas for project 234f69f21d7a456a9ab6a86c4ac2ede2. Resources: {'key_pairs'} {{(pid=127033) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 09:48:30.662162 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.quota [None req-b1ee72c4-eecc-45ac-97e5-1b04633711f8 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Getting quotas for user cfe6eb38e8df492daaef5755ddea7773 and project 234f69f21d7a456a9ab6a86c4ac2ede2. Resources: {'key_pairs'} {{(pid=127033) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 09:48:30.684286 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-b1ee72c4-eecc-45ac-97e5-1b04633711f8 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.050071 Oct 28 09:48:30.684943 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 154/311] 10.222.0.52 () {60 vars in 1159 bytes} [Fri Oct 28 09:48:30 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:48:30.913516 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-18c8de28-8694-4789-8673-f868f0cfd74d tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:30.914045 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-18c8de28-8694-4789-8673-f868f0cfd74d tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 6869ffb6-ce4f-4a91-b8d9-7765ea56e95a] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:30.921587 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-18c8de28-8694-4789-8673-f868f0cfd74d tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:30.922075 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-18c8de28-8694-4789-8673-f868f0cfd74d tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:30.922508 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-18c8de28-8694-4789-8673-f868f0cfd74d tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:30.923208 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-18c8de28-8694-4789-8673-f868f0cfd74d tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:30.923659 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-18c8de28-8694-4789-8673-f868f0cfd74d tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:30.924107 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-18c8de28-8694-4789-8673-f868f0cfd74d tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:31.077878 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-18c8de28-8694-4789-8673-f868f0cfd74d tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:31.079437 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-c54895c0-e9ea-4c52-ae50-2a90fcd7bf5e tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:31.080146 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-c54895c0-e9ea-4c52-ae50-2a90fcd7bf5e tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] [instance: 7ab20f71-d81e-4b6a-90f0-e4b0873c0469] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:31.088246 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-18c8de28-8694-4789-8673-f868f0cfd74d tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:31.089032 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-c54895c0-e9ea-4c52-ae50-2a90fcd7bf5e tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:31.089533 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-c54895c0-e9ea-4c52-ae50-2a90fcd7bf5e tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:31.089972 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-c54895c0-e9ea-4c52-ae50-2a90fcd7bf5e tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:31.090552 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-18c8de28-8694-4789-8673-f868f0cfd74d tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:31.090752 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-c54895c0-e9ea-4c52-ae50-2a90fcd7bf5e tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:31.091162 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-c54895c0-e9ea-4c52-ae50-2a90fcd7bf5e tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:31.091714 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-c54895c0-e9ea-4c52-ae50-2a90fcd7bf5e tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:31.091925 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-18c8de28-8694-4789-8673-f868f0cfd74d tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a" status: 200 len: 1720 microversion: 2.20 time: 0.182261 Oct 28 09:48:31.092533 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 158/312] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:48:30 2022] GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a => generated 1720 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:48:31.230716 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-c54895c0-e9ea-4c52-ae50-2a90fcd7bf5e tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05718633def4ad6822728767580b810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89c15d74a584be3b5e44f74ed50eea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:31.239828 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-c54895c0-e9ea-4c52-ae50-2a90fcd7bf5e tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] 10.222.0.52 "GET /compute/v2.1/servers/7ab20f71-d81e-4b6a-90f0-e4b0873c0469" status: 200 len: 1315 microversion: 2.1 time: 0.164971 Oct 28 09:48:31.240395 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 155/313] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:48:31 2022] GET /compute/v2.1/servers/7ab20f71-d81e-4b6a-90f0-e4b0873c0469 => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:48:31.481990 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-693ba11d-4220-4db9-8481-79a7787baa1f tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:31.482705 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-693ba11d-4220-4db9-8481-79a7787baa1f tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] [instance: 0e97301c-3a01-452d-b54a-6bf66c4793d9] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:31.489754 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-693ba11d-4220-4db9-8481-79a7787baa1f tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:31.490334 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-693ba11d-4220-4db9-8481-79a7787baa1f tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:31.490945 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-693ba11d-4220-4db9-8481-79a7787baa1f tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:31.491767 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-693ba11d-4220-4db9-8481-79a7787baa1f tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:31.492232 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-693ba11d-4220-4db9-8481-79a7787baa1f tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:31.492655 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-693ba11d-4220-4db9-8481-79a7787baa1f tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:31.525602 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-693ba11d-4220-4db9-8481-79a7787baa1f tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:31.526100 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-693ba11d-4220-4db9-8481-79a7787baa1f tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:31.526589 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-693ba11d-4220-4db9-8481-79a7787baa1f tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:31.527035 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.objects.instance [None req-693ba11d-4220-4db9-8481-79a7787baa1f tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lazy-loading 'fault' on Instance uuid 0e97301c-3a01-452d-b54a-6bf66c4793d9 {{(pid=127032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:48:31.573631 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-693ba11d-4220-4db9-8481-79a7787baa1f tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c1b55b5c04ba380ed8ffdaa462bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa6bd99403b4421acb8bd714c9450c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:31.583024 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-693ba11d-4220-4db9-8481-79a7787baa1f tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] 10.222.0.52 "GET /compute/v2.1/servers/0e97301c-3a01-452d-b54a-6bf66c4793d9" status: 200 len: 1304 microversion: 2.1 time: 0.105221 Oct 28 09:48:31.583597 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 159/314] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:48:31 2022] GET /compute/v2.1/servers/0e97301c-3a01-452d-b54a-6bf66c4793d9 => generated 1304 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:48:31.717749 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [req-a2946c6c-6919-4e5e-8519-38a88930aa55 req-60ab0d84-b01a-4fb4-a189-1f0212414408 admin admin] Action: 'create', calling method: >, body: {"snapshot": {"volume_id": "4adfb3fc-0236-45dc-a5b9-1e3c07a57b4b", "create_info": {"type": "qcow2", "new_file": "volume-4adfb3fc-0236-45dc-a5b9-1e3c07a57b4b.f6b07f38-1ae6-44cd-9c93-ea1ee0cfa783.vhdx", "snapshot_id": "f6b07f38-1ae6-44cd-9c93-ea1ee0cfa783"}}} {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:48:31.721466 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-a2946c6c-6919-4e5e-8519-38a88930aa55 req-60ab0d84-b01a-4fb4-a189-1f0212414408 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:31.722033 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-a2946c6c-6919-4e5e-8519-38a88930aa55 req-60ab0d84-b01a-4fb4-a189-1f0212414408 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:31.722687 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-a2946c6c-6919-4e5e-8519-38a88930aa55 req-60ab0d84-b01a-4fb4-a189-1f0212414408 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:31.733154 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-a2946c6c-6919-4e5e-8519-38a88930aa55 req-60ab0d84-b01a-4fb4-a189-1f0212414408 admin admin] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:31.733672 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-a2946c6c-6919-4e5e-8519-38a88930aa55 req-60ab0d84-b01a-4fb4-a189-1f0212414408 admin admin] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:31.734120 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-a2946c6c-6919-4e5e-8519-38a88930aa55 req-60ab0d84-b01a-4fb4-a189-1f0212414408 admin admin] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:31.748824 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [req-a2946c6c-6919-4e5e-8519-38a88930aa55 req-60ab0d84-b01a-4fb4-a189-1f0212414408 admin admin] 10.222.0.58 "POST /compute/v2.1/os-assisted-volume-snapshots" status: 200 len: 78 microversion: 2.1 time: 0.094606 Oct 28 09:48:31.749438 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 156/315] 10.222.0.58 () {64 vars in 1326 bytes} [Fri Oct 28 09:48:31 2022] POST /compute/v2.1/os-assisted-volume-snapshots => generated 78 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 09:48:32.118267 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-09c93ac6-9559-4c9c-b5cc-23bfc5c113a6 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:32.118971 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-09c93ac6-9559-4c9c-b5cc-23bfc5c113a6 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 6869ffb6-ce4f-4a91-b8d9-7765ea56e95a] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:32.124960 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-09c93ac6-9559-4c9c-b5cc-23bfc5c113a6 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:32.125501 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-09c93ac6-9559-4c9c-b5cc-23bfc5c113a6 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:32.125930 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-09c93ac6-9559-4c9c-b5cc-23bfc5c113a6 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:32.126610 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-09c93ac6-9559-4c9c-b5cc-23bfc5c113a6 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:32.127055 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-09c93ac6-9559-4c9c-b5cc-23bfc5c113a6 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:32.127470 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-09c93ac6-9559-4c9c-b5cc-23bfc5c113a6 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:32.263668 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-09c93ac6-9559-4c9c-b5cc-23bfc5c113a6 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:32.267756 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-d85ddf23-844b-4a7e-be1b-917e7910d124 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:32.272257 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-d85ddf23-844b-4a7e-be1b-917e7910d124 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] [instance: 7ab20f71-d81e-4b6a-90f0-e4b0873c0469] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:32.282825 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-d85ddf23-844b-4a7e-be1b-917e7910d124 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:32.283687 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-d85ddf23-844b-4a7e-be1b-917e7910d124 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:32.284266 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-d85ddf23-844b-4a7e-be1b-917e7910d124 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:32.285072 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-d85ddf23-844b-4a7e-be1b-917e7910d124 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:32.285824 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-d85ddf23-844b-4a7e-be1b-917e7910d124 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:32.286464 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-d85ddf23-844b-4a7e-be1b-917e7910d124 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:32.292075 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-09c93ac6-9559-4c9c-b5cc-23bfc5c113a6 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:32.296394 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-09c93ac6-9559-4c9c-b5cc-23bfc5c113a6 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:32.297606 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-09c93ac6-9559-4c9c-b5cc-23bfc5c113a6 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a" status: 200 len: 1720 microversion: 2.20 time: 0.183387 Oct 28 09:48:32.301374 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 160/316] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:48:32 2022] GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a => generated 1720 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:48:32.424212 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-3cffdb84-6d22-4dd2-8c5b-06132a81491b tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-622913141", "imageRef": "6e314146-a2ed-4f8b-afdd-4f7ed1184d20", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5c41d975-aca9-4f42-800d-41513480bec7"}], "security_groups": [{"name": "tempest-securitygroup--1391385695"}], "key_name": "tempest-keypair-1499224246", "user_data": "}} {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:48:32.447234 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-d85ddf23-844b-4a7e-be1b-917e7910d124 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05718633def4ad6822728767580b810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89c15d74a584be3b5e44f74ed50eea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:32.455638 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-d85ddf23-844b-4a7e-be1b-917e7910d124 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] 10.222.0.52 "GET /compute/v2.1/servers/7ab20f71-d81e-4b6a-90f0-e4b0873c0469" status: 200 len: 1315 microversion: 2.1 time: 0.196683 Oct 28 09:48:32.456262 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 157/317] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:48:32 2022] GET /compute/v2.1/servers/7ab20f71-d81e-4b6a-90f0-e4b0873c0469 => generated 1315 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:48:32.530949 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.network.neutron [None req-3cffdb84-6d22-4dd2-8c5b-06132a81491b tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] validate_networks() for [('5c41d975-aca9-4f42-800d-41513480bec7', None, None, None, None, None)] {{(pid=127032) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 09:48:32.606184 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-c463a35b-4f2f-494a-bd72-e128829d5bef tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:32.607055 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-c463a35b-4f2f-494a-bd72-e128829d5bef tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] [instance: 0e97301c-3a01-452d-b54a-6bf66c4793d9] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:32.613192 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-c463a35b-4f2f-494a-bd72-e128829d5bef tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:32.613680 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-c463a35b-4f2f-494a-bd72-e128829d5bef tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:32.614112 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-c463a35b-4f2f-494a-bd72-e128829d5bef tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:32.614811 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-c463a35b-4f2f-494a-bd72-e128829d5bef tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:32.615267 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-c463a35b-4f2f-494a-bd72-e128829d5bef tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:32.615691 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-c463a35b-4f2f-494a-bd72-e128829d5bef tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:32.653047 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-c463a35b-4f2f-494a-bd72-e128829d5bef tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:32.653678 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-c463a35b-4f2f-494a-bd72-e128829d5bef tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:32.654193 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-c463a35b-4f2f-494a-bd72-e128829d5bef tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:32.654706 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.objects.instance [None req-c463a35b-4f2f-494a-bd72-e128829d5bef tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lazy-loading 'fault' on Instance uuid 0e97301c-3a01-452d-b54a-6bf66c4793d9 {{(pid=127033) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:48:32.720259 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-c463a35b-4f2f-494a-bd72-e128829d5bef tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c1b55b5c04ba380ed8ffdaa462bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa6bd99403b4421acb8bd714c9450c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:32.727946 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-c463a35b-4f2f-494a-bd72-e128829d5bef tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] 10.222.0.52 "GET /compute/v2.1/servers/0e97301c-3a01-452d-b54a-6bf66c4793d9" status: 200 len: 1304 microversion: 2.1 time: 0.125547 Oct 28 09:48:32.728737 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 158/318] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:48:32 2022] GET /compute/v2.1/servers/0e97301c-3a01-452d-b54a-6bf66c4793d9 => generated 1304 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:48:32.947480 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.virt.hardware [None req-3cffdb84-6d22-4dd2-8c5b-06132a81491b tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Flavor limits 0:0:0 {{(pid=127032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 09:48:32.947938 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.virt.hardware [None req-3cffdb84-6d22-4dd2-8c5b-06132a81491b tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Image limits 0:0:0 {{(pid=127032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 09:48:32.948413 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.virt.hardware [None req-3cffdb84-6d22-4dd2-8c5b-06132a81491b tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Flavor pref 0:0:0 {{(pid=127032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 09:48:32.948826 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.virt.hardware [None req-3cffdb84-6d22-4dd2-8c5b-06132a81491b tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Image pref 0:0:0 {{(pid=127032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 09:48:32.949242 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.virt.hardware [None req-3cffdb84-6d22-4dd2-8c5b-06132a81491b tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 09:48:32.958764 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-3cffdb84-6d22-4dd2-8c5b-06132a81491b tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:32.959319 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-3cffdb84-6d22-4dd2-8c5b-06132a81491b tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:32.960324 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-3cffdb84-6d22-4dd2-8c5b-06132a81491b tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:32.961267 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-3cffdb84-6d22-4dd2-8c5b-06132a81491b tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:32.961898 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-3cffdb84-6d22-4dd2-8c5b-06132a81491b tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:32.962323 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-3cffdb84-6d22-4dd2-8c5b-06132a81491b tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:32.980703 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.quota [None req-3cffdb84-6d22-4dd2-8c5b-06132a81491b tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Getting quotas for project 234f69f21d7a456a9ab6a86c4ac2ede2. Resources: {'cores', 'ram', 'instances'} {{(pid=127032) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 09:48:32.986421 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.quota [None req-3cffdb84-6d22-4dd2-8c5b-06132a81491b tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Getting quotas for user cfe6eb38e8df492daaef5755ddea7773 and project 234f69f21d7a456a9ab6a86c4ac2ede2. Resources: {'cores', 'ram', 'instances'} {{(pid=127032) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 09:48:32.998987 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-3cffdb84-6d22-4dd2-8c5b-06132a81491b tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Going to run 1 instances... {{(pid=127032) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 09:48:33.001323 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-3cffdb84-6d22-4dd2-8c5b-06132a81491b tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: e6ddb7f9-7854-4aa1-a174-2048b9a40431] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e314146-a2ed-4f8b-afdd-4f7ed1184d20',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127032) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 09:48:33.054818 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-3cffdb84-6d22-4dd2-8c5b-06132a81491b tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.635030 Oct 28 09:48:33.055926 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 161/319] 10.222.0.52 () {60 vars in 1147 bytes} [Fri Oct 28 09:48:32 2022] POST /compute/v2.1/servers => generated 409 bytes in 636 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 09:48:33.067184 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-1a5f6773-913b-47b6-ad0f-dd09cfc707f4 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:33.067936 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-1a5f6773-913b-47b6-ad0f-dd09cfc707f4 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: e6ddb7f9-7854-4aa1-a174-2048b9a40431] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:33.125856 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-1a5f6773-913b-47b6-ad0f-dd09cfc707f4 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe6eb38e8df492daaef5755ddea7773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234f69f21d7a456a9ab6a86c4ac2ede2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:33.132953 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-1a5f6773-913b-47b6-ad0f-dd09cfc707f4 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] 10.222.0.52 "GET /compute/v2.1/servers/e6ddb7f9-7854-4aa1-a174-2048b9a40431" status: 200 len: 1245 microversion: 2.1 time: 0.069740 Oct 28 09:48:33.133562 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 159/320] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:48:33 2022] GET /compute/v2.1/servers/e6ddb7f9-7854-4aa1-a174-2048b9a40431 => generated 1245 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:48:33.323797 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-19bee498-2683-4861-bd8b-fecc3e754ace tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:33.324404 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-19bee498-2683-4861-bd8b-fecc3e754ace tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 6869ffb6-ce4f-4a91-b8d9-7765ea56e95a] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:33.331081 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-19bee498-2683-4861-bd8b-fecc3e754ace tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:33.331567 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-19bee498-2683-4861-bd8b-fecc3e754ace tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:33.332025 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-19bee498-2683-4861-bd8b-fecc3e754ace tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:33.332709 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-19bee498-2683-4861-bd8b-fecc3e754ace tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:33.333154 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-19bee498-2683-4861-bd8b-fecc3e754ace tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:33.333569 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-19bee498-2683-4861-bd8b-fecc3e754ace tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:33.474483 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-19bee498-2683-4861-bd8b-fecc3e754ace tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:33.484293 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-ed42b85f-46eb-4970-9f7b-1e049893ab34 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:33.484906 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-19bee498-2683-4861-bd8b-fecc3e754ace tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:33.485668 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-ed42b85f-46eb-4970-9f7b-1e049893ab34 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] [instance: 7ab20f71-d81e-4b6a-90f0-e4b0873c0469] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:33.487303 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-19bee498-2683-4861-bd8b-fecc3e754ace tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:33.488630 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-19bee498-2683-4861-bd8b-fecc3e754ace tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a" status: 200 len: 1720 microversion: 2.20 time: 0.169328 Oct 28 09:48:33.489299 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 162/321] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:48:33 2022] GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a => generated 1720 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:48:33.498360 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-ed42b85f-46eb-4970-9f7b-1e049893ab34 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:33.498985 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-ed42b85f-46eb-4970-9f7b-1e049893ab34 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:33.499511 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-ed42b85f-46eb-4970-9f7b-1e049893ab34 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:33.500380 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-ed42b85f-46eb-4970-9f7b-1e049893ab34 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:33.500902 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-ed42b85f-46eb-4970-9f7b-1e049893ab34 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:33.501385 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-ed42b85f-46eb-4970-9f7b-1e049893ab34 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:33.640712 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-ed42b85f-46eb-4970-9f7b-1e049893ab34 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05718633def4ad6822728767580b810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89c15d74a584be3b5e44f74ed50eea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:33.648420 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-ed42b85f-46eb-4970-9f7b-1e049893ab34 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] 10.222.0.52 "GET /compute/v2.1/servers/7ab20f71-d81e-4b6a-90f0-e4b0873c0469" status: 200 len: 1463 microversion: 2.1 time: 0.173566 Oct 28 09:48:33.648989 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 160/322] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:48:33 2022] GET /compute/v2.1/servers/7ab20f71-d81e-4b6a-90f0-e4b0873c0469 => generated 1463 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:48:33.698265 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-f3f74663-f46d-4e66-b7bd-a7724084cbb4 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:33.698806 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-f3f74663-f46d-4e66-b7bd-a7724084cbb4 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] [instance: 7ab20f71-d81e-4b6a-90f0-e4b0873c0469] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:33.705241 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-f3f74663-f46d-4e66-b7bd-a7724084cbb4 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:33.705721 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-f3f74663-f46d-4e66-b7bd-a7724084cbb4 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:33.706150 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-f3f74663-f46d-4e66-b7bd-a7724084cbb4 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:33.706840 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-f3f74663-f46d-4e66-b7bd-a7724084cbb4 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:33.707296 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-f3f74663-f46d-4e66-b7bd-a7724084cbb4 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:33.707765 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-f3f74663-f46d-4e66-b7bd-a7724084cbb4 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:33.733233 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-f3f74663-f46d-4e66-b7bd-a7724084cbb4 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] [instance: 7ab20f71-d81e-4b6a-90f0-e4b0873c0469] Going to try to terminate instance {{(pid=127032) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 09:48:33.750608 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-03f596b7-f26d-4459-ab85-2f05a3482eda tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:33.751307 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-03f596b7-f26d-4459-ab85-2f05a3482eda tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] [instance: 0e97301c-3a01-452d-b54a-6bf66c4793d9] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:33.757908 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-03f596b7-f26d-4459-ab85-2f05a3482eda tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:33.758520 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-03f596b7-f26d-4459-ab85-2f05a3482eda tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:33.759531 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-03f596b7-f26d-4459-ab85-2f05a3482eda tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:33.760251 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-03f596b7-f26d-4459-ab85-2f05a3482eda tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:33.760709 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-03f596b7-f26d-4459-ab85-2f05a3482eda tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:33.761133 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-03f596b7-f26d-4459-ab85-2f05a3482eda tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:33.792563 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-03f596b7-f26d-4459-ab85-2f05a3482eda tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:33.793046 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-03f596b7-f26d-4459-ab85-2f05a3482eda tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:33.793541 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-03f596b7-f26d-4459-ab85-2f05a3482eda tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:33.794013 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.objects.instance [None req-03f596b7-f26d-4459-ab85-2f05a3482eda tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lazy-loading 'fault' on Instance uuid 0e97301c-3a01-452d-b54a-6bf66c4793d9 {{(pid=127033) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:48:33.813180 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-f3f74663-f46d-4e66-b7bd-a7724084cbb4 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] 10.222.0.52 "DELETE /compute/v2.1/servers/7ab20f71-d81e-4b6a-90f0-e4b0873c0469" status: 204 len: 0 microversion: 2.1 time: 0.119251 Oct 28 09:48:33.813986 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 163/323] 10.222.0.52 () {58 vars in 1239 bytes} [Fri Oct 28 09:48:33 2022] DELETE /compute/v2.1/servers/7ab20f71-d81e-4b6a-90f0-e4b0873c0469 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 09:48:33.825119 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-77eceb48-d19a-4730-989d-195fab140182 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:33.826451 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-77eceb48-d19a-4730-989d-195fab140182 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] [instance: 7ab20f71-d81e-4b6a-90f0-e4b0873c0469] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:33.836061 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-77eceb48-d19a-4730-989d-195fab140182 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:33.837306 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-77eceb48-d19a-4730-989d-195fab140182 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:33.837999 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-77eceb48-d19a-4730-989d-195fab140182 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:33.838656 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-77eceb48-d19a-4730-989d-195fab140182 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:33.838983 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-77eceb48-d19a-4730-989d-195fab140182 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:33.839407 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-77eceb48-d19a-4730-989d-195fab140182 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:33.841756 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-03f596b7-f26d-4459-ab85-2f05a3482eda tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c1b55b5c04ba380ed8ffdaa462bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa6bd99403b4421acb8bd714c9450c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:33.849864 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-03f596b7-f26d-4459-ab85-2f05a3482eda tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] 10.222.0.52 "GET /compute/v2.1/servers/0e97301c-3a01-452d-b54a-6bf66c4793d9" status: 200 len: 1304 microversion: 2.1 time: 0.103005 Oct 28 09:48:33.850445 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 161/324] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:48:33 2022] GET /compute/v2.1/servers/0e97301c-3a01-452d-b54a-6bf66c4793d9 => generated 1304 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:48:33.973852 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-77eceb48-d19a-4730-989d-195fab140182 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05718633def4ad6822728767580b810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89c15d74a584be3b5e44f74ed50eea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:33.982516 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-77eceb48-d19a-4730-989d-195fab140182 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] 10.222.0.52 "GET /compute/v2.1/servers/7ab20f71-d81e-4b6a-90f0-e4b0873c0469" status: 200 len: 1469 microversion: 2.1 time: 0.164201 Oct 28 09:48:33.983100 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 164/325] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:48:33 2022] GET /compute/v2.1/servers/7ab20f71-d81e-4b6a-90f0-e4b0873c0469 => generated 1469 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:48:34.156362 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-26ebdc34-109c-449c-87e1-a74421a8ab16 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:34.157251 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-26ebdc34-109c-449c-87e1-a74421a8ab16 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: e6ddb7f9-7854-4aa1-a174-2048b9a40431] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:34.163024 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-26ebdc34-109c-449c-87e1-a74421a8ab16 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:34.163517 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-26ebdc34-109c-449c-87e1-a74421a8ab16 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:34.163990 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-26ebdc34-109c-449c-87e1-a74421a8ab16 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:34.164816 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-26ebdc34-109c-449c-87e1-a74421a8ab16 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:34.165289 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-26ebdc34-109c-449c-87e1-a74421a8ab16 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:34.165715 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-26ebdc34-109c-449c-87e1-a74421a8ab16 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:34.229708 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-26ebdc34-109c-449c-87e1-a74421a8ab16 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe6eb38e8df492daaef5755ddea7773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234f69f21d7a456a9ab6a86c4ac2ede2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:34.237575 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-26ebdc34-109c-449c-87e1-a74421a8ab16 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] 10.222.0.52 "GET /compute/v2.1/servers/e6ddb7f9-7854-4aa1-a174-2048b9a40431" status: 200 len: 1249 microversion: 2.1 time: 0.085040 Oct 28 09:48:34.238180 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 162/326] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:48:34 2022] GET /compute/v2.1/servers/e6ddb7f9-7854-4aa1-a174-2048b9a40431 => generated 1249 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:48:34.516515 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-33a72685-a6da-41dc-8235-5b0da564adde tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:34.517094 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-33a72685-a6da-41dc-8235-5b0da564adde tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 6869ffb6-ce4f-4a91-b8d9-7765ea56e95a] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:34.526784 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-33a72685-a6da-41dc-8235-5b0da564adde tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:34.527210 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-33a72685-a6da-41dc-8235-5b0da564adde tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:34.527620 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-33a72685-a6da-41dc-8235-5b0da564adde tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:34.528334 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-33a72685-a6da-41dc-8235-5b0da564adde tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:34.528778 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-33a72685-a6da-41dc-8235-5b0da564adde tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:34.529189 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-33a72685-a6da-41dc-8235-5b0da564adde tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:34.660866 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-7fb38c03-8cae-4cda-b3d2-414eefadc226 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:48:34.666916 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-7fb38c03-8cae-4cda-b3d2-414eefadc226 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:34.667472 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-7fb38c03-8cae-4cda-b3d2-414eefadc226 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:34.668008 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-7fb38c03-8cae-4cda-b3d2-414eefadc226 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:34.686213 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-33a72685-a6da-41dc-8235-5b0da564adde tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:34.694333 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-33a72685-a6da-41dc-8235-5b0da564adde tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:34.695809 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-33a72685-a6da-41dc-8235-5b0da564adde tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:34.698178 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-33a72685-a6da-41dc-8235-5b0da564adde tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a" status: 200 len: 1720 microversion: 2.20 time: 0.185711 Oct 28 09:48:34.698936 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 165/327] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:48:34 2022] GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a => generated 1720 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:48:34.731331 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-7fb38c03-8cae-4cda-b3d2-414eefadc226 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] [instance: 91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1] Going to try to stop instance {{(pid=127033) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 28 09:48:34.772864 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-7fb38c03-8cae-4cda-b3d2-414eefadc226 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] 10.222.0.52 "POST /compute/v2.1/servers/91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1/action" status: 202 len: 0 microversion: 2.1 time: 0.116279 Oct 28 09:48:34.773535 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 163/328] 10.222.0.52 () {60 vars in 1278 bytes} [Fri Oct 28 09:48:34 2022] POST /compute/v2.1/servers/91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 09:48:34.781655 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-9afe51be-f686-43c7-8083-6ba8a8bdea44 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:34.782249 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-9afe51be-f686-43c7-8083-6ba8a8bdea44 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] [instance: 91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:34.788558 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-9afe51be-f686-43c7-8083-6ba8a8bdea44 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:34.789040 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-9afe51be-f686-43c7-8083-6ba8a8bdea44 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:34.789469 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-9afe51be-f686-43c7-8083-6ba8a8bdea44 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:34.790652 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-9afe51be-f686-43c7-8083-6ba8a8bdea44 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:34.791094 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-9afe51be-f686-43c7-8083-6ba8a8bdea44 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:34.791510 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-9afe51be-f686-43c7-8083-6ba8a8bdea44 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:34.875482 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-80f5fddc-4e48-4b2d-9299-596e1d6b551a tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:34.876507 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-80f5fddc-4e48-4b2d-9299-596e1d6b551a tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] [instance: 0e97301c-3a01-452d-b54a-6bf66c4793d9] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:34.883641 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-80f5fddc-4e48-4b2d-9299-596e1d6b551a tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:34.884223 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-80f5fddc-4e48-4b2d-9299-596e1d6b551a tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:34.884792 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-80f5fddc-4e48-4b2d-9299-596e1d6b551a tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:34.885630 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-80f5fddc-4e48-4b2d-9299-596e1d6b551a tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:34.886151 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-80f5fddc-4e48-4b2d-9299-596e1d6b551a tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:34.886630 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-80f5fddc-4e48-4b2d-9299-596e1d6b551a tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:34.918272 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-80f5fddc-4e48-4b2d-9299-596e1d6b551a tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:34.918779 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-80f5fddc-4e48-4b2d-9299-596e1d6b551a tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:34.919251 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-80f5fddc-4e48-4b2d-9299-596e1d6b551a tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:34.919698 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.objects.instance [None req-80f5fddc-4e48-4b2d-9299-596e1d6b551a tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lazy-loading 'fault' on Instance uuid 0e97301c-3a01-452d-b54a-6bf66c4793d9 {{(pid=127033) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:48:34.920309 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-9afe51be-f686-43c7-8083-6ba8a8bdea44 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bee2d5f599642788c32e0d8b8338c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e7d531c0f4a33a869309af965e3e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:34.922726 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG dbcounter [-] [127032] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:48:34.929860 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-9afe51be-f686-43c7-8083-6ba8a8bdea44 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] 10.222.0.52 "GET /compute/v2.1/servers/91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1" status: 200 len: 1722 microversion: 2.1 time: 0.151953 Oct 28 09:48:34.930497 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 166/329] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:48:34 2022] GET /compute/v2.1/servers/91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:48:34.963622 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-80f5fddc-4e48-4b2d-9299-596e1d6b551a tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c1b55b5c04ba380ed8ffdaa462bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa6bd99403b4421acb8bd714c9450c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:34.971255 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-80f5fddc-4e48-4b2d-9299-596e1d6b551a tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] 10.222.0.52 "GET /compute/v2.1/servers/0e97301c-3a01-452d-b54a-6bf66c4793d9" status: 200 len: 1304 microversion: 2.1 time: 0.100266 Oct 28 09:48:34.971940 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 164/330] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:48:34 2022] GET /compute/v2.1/servers/0e97301c-3a01-452d-b54a-6bf66c4793d9 => generated 1304 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:48:35.007414 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-ceae5275-5ce8-4709-93b7-9f3ce90a9063 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:35.007974 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-ceae5275-5ce8-4709-93b7-9f3ce90a9063 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] [instance: 7ab20f71-d81e-4b6a-90f0-e4b0873c0469] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:35.015982 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ceae5275-5ce8-4709-93b7-9f3ce90a9063 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:35.016693 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ceae5275-5ce8-4709-93b7-9f3ce90a9063 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:35.017191 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ceae5275-5ce8-4709-93b7-9f3ce90a9063 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:35.017929 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ceae5275-5ce8-4709-93b7-9f3ce90a9063 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:35.018431 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ceae5275-5ce8-4709-93b7-9f3ce90a9063 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:35.018930 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ceae5275-5ce8-4709-93b7-9f3ce90a9063 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:35.166268 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-ceae5275-5ce8-4709-93b7-9f3ce90a9063 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05718633def4ad6822728767580b810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89c15d74a584be3b5e44f74ed50eea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:35.175022 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-ceae5275-5ce8-4709-93b7-9f3ce90a9063 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] 10.222.0.52 "GET /compute/v2.1/servers/7ab20f71-d81e-4b6a-90f0-e4b0873c0469" status: 200 len: 1469 microversion: 2.1 time: 0.173339 Oct 28 09:48:35.175931 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 167/331] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:48:35 2022] GET /compute/v2.1/servers/7ab20f71-d81e-4b6a-90f0-e4b0873c0469 => generated 1469 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:48:35.259328 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-de5413b8-0888-4dd2-b0d3-f1c6ce5ddb4e tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:35.259892 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-de5413b8-0888-4dd2-b0d3-f1c6ce5ddb4e tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: e6ddb7f9-7854-4aa1-a174-2048b9a40431] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:35.265975 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-de5413b8-0888-4dd2-b0d3-f1c6ce5ddb4e tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:35.266458 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-de5413b8-0888-4dd2-b0d3-f1c6ce5ddb4e tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:35.266885 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-de5413b8-0888-4dd2-b0d3-f1c6ce5ddb4e tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:35.267561 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-de5413b8-0888-4dd2-b0d3-f1c6ce5ddb4e tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:35.268040 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-de5413b8-0888-4dd2-b0d3-f1c6ce5ddb4e tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:35.268459 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-de5413b8-0888-4dd2-b0d3-f1c6ce5ddb4e tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:35.328377 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-de5413b8-0888-4dd2-b0d3-f1c6ce5ddb4e tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe6eb38e8df492daaef5755ddea7773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234f69f21d7a456a9ab6a86c4ac2ede2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:35.335928 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-de5413b8-0888-4dd2-b0d3-f1c6ce5ddb4e tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] 10.222.0.52 "GET /compute/v2.1/servers/e6ddb7f9-7854-4aa1-a174-2048b9a40431" status: 200 len: 1241 microversion: 2.1 time: 0.080534 Oct 28 09:48:35.336486 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 165/332] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:48:35 2022] GET /compute/v2.1/servers/e6ddb7f9-7854-4aa1-a174-2048b9a40431 => generated 1241 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:48:35.723186 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-d9f1d942-0a7a-4675-86f6-0dc21200d05e tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:35.723811 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-d9f1d942-0a7a-4675-86f6-0dc21200d05e tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 6869ffb6-ce4f-4a91-b8d9-7765ea56e95a] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:35.729845 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-d9f1d942-0a7a-4675-86f6-0dc21200d05e tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:35.730329 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-d9f1d942-0a7a-4675-86f6-0dc21200d05e tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:35.730763 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-d9f1d942-0a7a-4675-86f6-0dc21200d05e tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:35.731453 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-d9f1d942-0a7a-4675-86f6-0dc21200d05e tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:35.732195 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-d9f1d942-0a7a-4675-86f6-0dc21200d05e tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:35.732726 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-d9f1d942-0a7a-4675-86f6-0dc21200d05e tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:35.864055 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-d9f1d942-0a7a-4675-86f6-0dc21200d05e tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:35.872496 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-d9f1d942-0a7a-4675-86f6-0dc21200d05e tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:35.873919 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-d9f1d942-0a7a-4675-86f6-0dc21200d05e tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:35.875070 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-d9f1d942-0a7a-4675-86f6-0dc21200d05e tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a" status: 200 len: 1720 microversion: 2.20 time: 0.155863 Oct 28 09:48:35.875616 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 168/333] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:48:35 2022] GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a => generated 1720 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:48:35.953035 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-a302fedc-b7d2-42bc-aafe-ebec671e7203 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:35.953646 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-a302fedc-b7d2-42bc-aafe-ebec671e7203 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] [instance: 91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:35.960096 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-a302fedc-b7d2-42bc-aafe-ebec671e7203 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:35.960847 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-a302fedc-b7d2-42bc-aafe-ebec671e7203 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:35.961282 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-a302fedc-b7d2-42bc-aafe-ebec671e7203 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:35.962536 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-a302fedc-b7d2-42bc-aafe-ebec671e7203 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:35.962992 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-a302fedc-b7d2-42bc-aafe-ebec671e7203 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:35.963415 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-a302fedc-b7d2-42bc-aafe-ebec671e7203 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:35.994350 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-7a2bf109-815a-44ed-87fd-41f816ad2a7e tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:35.994948 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-7a2bf109-815a-44ed-87fd-41f816ad2a7e tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] [instance: 0e97301c-3a01-452d-b54a-6bf66c4793d9] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:36.001061 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-7a2bf109-815a-44ed-87fd-41f816ad2a7e tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:36.001538 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-7a2bf109-815a-44ed-87fd-41f816ad2a7e tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:36.001962 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-7a2bf109-815a-44ed-87fd-41f816ad2a7e tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:36.002642 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-7a2bf109-815a-44ed-87fd-41f816ad2a7e tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:36.003087 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-7a2bf109-815a-44ed-87fd-41f816ad2a7e tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:36.003501 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-7a2bf109-815a-44ed-87fd-41f816ad2a7e tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:36.035861 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-7a2bf109-815a-44ed-87fd-41f816ad2a7e tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:36.036334 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-7a2bf109-815a-44ed-87fd-41f816ad2a7e tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:36.036757 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-7a2bf109-815a-44ed-87fd-41f816ad2a7e tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:36.037190 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.objects.instance [None req-7a2bf109-815a-44ed-87fd-41f816ad2a7e tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lazy-loading 'fault' on Instance uuid 0e97301c-3a01-452d-b54a-6bf66c4793d9 {{(pid=127032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:48:36.081548 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-7a2bf109-815a-44ed-87fd-41f816ad2a7e tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c1b55b5c04ba380ed8ffdaa462bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa6bd99403b4421acb8bd714c9450c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:36.089737 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-7a2bf109-815a-44ed-87fd-41f816ad2a7e tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] 10.222.0.52 "GET /compute/v2.1/servers/0e97301c-3a01-452d-b54a-6bf66c4793d9" status: 200 len: 1304 microversion: 2.1 time: 0.099149 Oct 28 09:48:36.090319 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 169/334] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:48:35 2022] GET /compute/v2.1/servers/0e97301c-3a01-452d-b54a-6bf66c4793d9 => generated 1304 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:48:36.118724 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-a302fedc-b7d2-42bc-aafe-ebec671e7203 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bee2d5f599642788c32e0d8b8338c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e7d531c0f4a33a869309af965e3e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:36.127139 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-a302fedc-b7d2-42bc-aafe-ebec671e7203 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] 10.222.0.52 "GET /compute/v2.1/servers/91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1" status: 200 len: 1722 microversion: 2.1 time: 0.177930 Oct 28 09:48:36.127697 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 166/335] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:48:35 2022] GET /compute/v2.1/servers/91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1 => generated 1722 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:48:36.199023 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-181dfe78-ac79-49a9-91b1-c61a0fb49eb1 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:36.199627 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-181dfe78-ac79-49a9-91b1-c61a0fb49eb1 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] [instance: 7ab20f71-d81e-4b6a-90f0-e4b0873c0469] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:36.205680 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-181dfe78-ac79-49a9-91b1-c61a0fb49eb1 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:36.206161 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-181dfe78-ac79-49a9-91b1-c61a0fb49eb1 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:36.206591 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-181dfe78-ac79-49a9-91b1-c61a0fb49eb1 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:36.207382 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-181dfe78-ac79-49a9-91b1-c61a0fb49eb1 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:36.207892 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-181dfe78-ac79-49a9-91b1-c61a0fb49eb1 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:36.208314 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-181dfe78-ac79-49a9-91b1-c61a0fb49eb1 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:36.339103 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-181dfe78-ac79-49a9-91b1-c61a0fb49eb1 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05718633def4ad6822728767580b810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89c15d74a584be3b5e44f74ed50eea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:36.346658 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-181dfe78-ac79-49a9-91b1-c61a0fb49eb1 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] 10.222.0.52 "GET /compute/v2.1/servers/7ab20f71-d81e-4b6a-90f0-e4b0873c0469" status: 200 len: 1469 microversion: 2.1 time: 0.152116 Oct 28 09:48:36.347344 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 170/336] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:48:36 2022] GET /compute/v2.1/servers/7ab20f71-d81e-4b6a-90f0-e4b0873c0469 => generated 1469 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:48:36.358654 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-4487f075-0632-4065-922f-ebf17c71de32 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:36.359265 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-4487f075-0632-4065-922f-ebf17c71de32 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: e6ddb7f9-7854-4aa1-a174-2048b9a40431] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:36.365483 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-4487f075-0632-4065-922f-ebf17c71de32 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:36.365912 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-4487f075-0632-4065-922f-ebf17c71de32 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:36.366386 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-4487f075-0632-4065-922f-ebf17c71de32 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:36.367073 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-4487f075-0632-4065-922f-ebf17c71de32 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:36.367528 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-4487f075-0632-4065-922f-ebf17c71de32 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:36.367984 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-4487f075-0632-4065-922f-ebf17c71de32 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:36.429077 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-4487f075-0632-4065-922f-ebf17c71de32 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe6eb38e8df492daaef5755ddea7773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234f69f21d7a456a9ab6a86c4ac2ede2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:36.436708 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-4487f075-0632-4065-922f-ebf17c71de32 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] 10.222.0.52 "GET /compute/v2.1/servers/e6ddb7f9-7854-4aa1-a174-2048b9a40431" status: 200 len: 1241 microversion: 2.1 time: 0.082222 Oct 28 09:48:36.437278 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 167/337] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:48:36 2022] GET /compute/v2.1/servers/e6ddb7f9-7854-4aa1-a174-2048b9a40431 => generated 1241 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:48:36.901493 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-b9fdecf3-5ed9-42d1-96a9-887f4d9fee31 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:36.902024 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-b9fdecf3-5ed9-42d1-96a9-887f4d9fee31 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 6869ffb6-ce4f-4a91-b8d9-7765ea56e95a] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:36.908695 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-b9fdecf3-5ed9-42d1-96a9-887f4d9fee31 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:36.909175 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-b9fdecf3-5ed9-42d1-96a9-887f4d9fee31 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:36.909604 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-b9fdecf3-5ed9-42d1-96a9-887f4d9fee31 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:36.910281 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-b9fdecf3-5ed9-42d1-96a9-887f4d9fee31 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:36.910730 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-b9fdecf3-5ed9-42d1-96a9-887f4d9fee31 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:36.911144 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-b9fdecf3-5ed9-42d1-96a9-887f4d9fee31 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:37.039897 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-b9fdecf3-5ed9-42d1-96a9-887f4d9fee31 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:37.048093 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-b9fdecf3-5ed9-42d1-96a9-887f4d9fee31 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:37.049553 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-b9fdecf3-5ed9-42d1-96a9-887f4d9fee31 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:37.050717 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-b9fdecf3-5ed9-42d1-96a9-887f4d9fee31 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a" status: 200 len: 1720 microversion: 2.20 time: 0.153764 Oct 28 09:48:37.051282 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 171/338] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:48:36 2022] GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a => generated 1720 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:48:37.113447 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-0887dd1e-f058-4f4e-ab81-3ddbd0e4375f tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:37.114041 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-0887dd1e-f058-4f4e-ab81-3ddbd0e4375f tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] [instance: 0e97301c-3a01-452d-b54a-6bf66c4793d9] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:37.120501 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-0887dd1e-f058-4f4e-ab81-3ddbd0e4375f tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:37.120985 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-0887dd1e-f058-4f4e-ab81-3ddbd0e4375f tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:37.121414 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-0887dd1e-f058-4f4e-ab81-3ddbd0e4375f tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:37.122094 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-0887dd1e-f058-4f4e-ab81-3ddbd0e4375f tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:37.122549 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-0887dd1e-f058-4f4e-ab81-3ddbd0e4375f tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:37.122961 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-0887dd1e-f058-4f4e-ab81-3ddbd0e4375f tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:37.150947 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-571c4a0e-8b6b-4a14-95e9-2fdb08c92027 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:37.151610 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-571c4a0e-8b6b-4a14-95e9-2fdb08c92027 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] [instance: 91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:37.157513 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-571c4a0e-8b6b-4a14-95e9-2fdb08c92027 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:37.157661 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-0887dd1e-f058-4f4e-ab81-3ddbd0e4375f tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:37.157999 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-571c4a0e-8b6b-4a14-95e9-2fdb08c92027 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:37.158116 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-0887dd1e-f058-4f4e-ab81-3ddbd0e4375f tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:37.158436 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-571c4a0e-8b6b-4a14-95e9-2fdb08c92027 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:37.158560 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-0887dd1e-f058-4f4e-ab81-3ddbd0e4375f tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:37.158966 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.objects.instance [None req-0887dd1e-f058-4f4e-ab81-3ddbd0e4375f tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lazy-loading 'fault' on Instance uuid 0e97301c-3a01-452d-b54a-6bf66c4793d9 {{(pid=127033) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:48:37.159116 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-571c4a0e-8b6b-4a14-95e9-2fdb08c92027 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:37.159568 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-571c4a0e-8b6b-4a14-95e9-2fdb08c92027 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:37.160021 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-571c4a0e-8b6b-4a14-95e9-2fdb08c92027 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:37.203916 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-0887dd1e-f058-4f4e-ab81-3ddbd0e4375f tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c1b55b5c04ba380ed8ffdaa462bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa6bd99403b4421acb8bd714c9450c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:37.208084 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG dbcounter [-] [127033] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:48:37.214219 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-0887dd1e-f058-4f4e-ab81-3ddbd0e4375f tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] 10.222.0.52 "GET /compute/v2.1/servers/0e97301c-3a01-452d-b54a-6bf66c4793d9" status: 200 len: 1304 microversion: 2.1 time: 0.104496 Oct 28 09:48:37.214947 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 168/339] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:48:37 2022] GET /compute/v2.1/servers/0e97301c-3a01-452d-b54a-6bf66c4793d9 => generated 1304 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:48:37.298542 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-571c4a0e-8b6b-4a14-95e9-2fdb08c92027 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bee2d5f599642788c32e0d8b8338c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e7d531c0f4a33a869309af965e3e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:37.306777 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-571c4a0e-8b6b-4a14-95e9-2fdb08c92027 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] 10.222.0.52 "GET /compute/v2.1/servers/91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1" status: 200 len: 1722 microversion: 2.1 time: 0.160362 Oct 28 09:48:37.307343 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 172/340] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:48:37 2022] GET /compute/v2.1/servers/91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:48:37.371169 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-b3788fc4-2cab-40c8-8558-fb96c6b73e85 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:37.371825 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-b3788fc4-2cab-40c8-8558-fb96c6b73e85 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] [instance: 7ab20f71-d81e-4b6a-90f0-e4b0873c0469] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:37.378680 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-b3788fc4-2cab-40c8-8558-fb96c6b73e85 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:37.379154 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-b3788fc4-2cab-40c8-8558-fb96c6b73e85 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:37.379589 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-b3788fc4-2cab-40c8-8558-fb96c6b73e85 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:37.380296 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-b3788fc4-2cab-40c8-8558-fb96c6b73e85 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:37.380743 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-b3788fc4-2cab-40c8-8558-fb96c6b73e85 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:37.381154 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-b3788fc4-2cab-40c8-8558-fb96c6b73e85 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:37.461510 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-b6356669-c6a3-4abf-ad80-be1cdcb32800 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:37.462731 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-b6356669-c6a3-4abf-ad80-be1cdcb32800 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: e6ddb7f9-7854-4aa1-a174-2048b9a40431] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:37.470080 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-b6356669-c6a3-4abf-ad80-be1cdcb32800 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:37.470817 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-b6356669-c6a3-4abf-ad80-be1cdcb32800 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:37.471256 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-b6356669-c6a3-4abf-ad80-be1cdcb32800 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:37.471987 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-b6356669-c6a3-4abf-ad80-be1cdcb32800 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:37.472584 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-b6356669-c6a3-4abf-ad80-be1cdcb32800 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:37.473010 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-b6356669-c6a3-4abf-ad80-be1cdcb32800 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:37.527610 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-b3788fc4-2cab-40c8-8558-fb96c6b73e85 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05718633def4ad6822728767580b810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89c15d74a584be3b5e44f74ed50eea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:37.535514 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-b3788fc4-2cab-40c8-8558-fb96c6b73e85 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] 10.222.0.52 "GET /compute/v2.1/servers/7ab20f71-d81e-4b6a-90f0-e4b0873c0469" status: 200 len: 1469 microversion: 2.1 time: 0.168911 Oct 28 09:48:37.536200 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 169/341] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:48:37 2022] GET /compute/v2.1/servers/7ab20f71-d81e-4b6a-90f0-e4b0873c0469 => generated 1469 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:48:37.546254 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-b6356669-c6a3-4abf-ad80-be1cdcb32800 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe6eb38e8df492daaef5755ddea7773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234f69f21d7a456a9ab6a86c4ac2ede2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:37.553967 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-b6356669-c6a3-4abf-ad80-be1cdcb32800 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] 10.222.0.52 "GET /compute/v2.1/servers/e6ddb7f9-7854-4aa1-a174-2048b9a40431" status: 200 len: 1297 microversion: 2.1 time: 0.096396 Oct 28 09:48:37.554523 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 173/342] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:48:37 2022] GET /compute/v2.1/servers/e6ddb7f9-7854-4aa1-a174-2048b9a40431 => generated 1297 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:48:37.879138 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [req-9ba5de42-4b06-4f20-8f1f-c490df1a3692 req-64e46196-942b-4b86-a44a-b73fc4da749d admin admin] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:37.884748 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-9ba5de42-4b06-4f20-8f1f-c490df1a3692 req-64e46196-942b-4b86-a44a-b73fc4da749d admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:37.885236 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-9ba5de42-4b06-4f20-8f1f-c490df1a3692 req-64e46196-942b-4b86-a44a-b73fc4da749d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:37.885671 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-9ba5de42-4b06-4f20-8f1f-c490df1a3692 req-64e46196-942b-4b86-a44a-b73fc4da749d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:37.893871 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-9ba5de42-4b06-4f20-8f1f-c490df1a3692 req-64e46196-942b-4b86-a44a-b73fc4da749d admin admin] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:37.894349 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-9ba5de42-4b06-4f20-8f1f-c490df1a3692 req-64e46196-942b-4b86-a44a-b73fc4da749d admin admin] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:37.894772 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-9ba5de42-4b06-4f20-8f1f-c490df1a3692 req-64e46196-942b-4b86-a44a-b73fc4da749d admin admin] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:37.909559 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [req-9ba5de42-4b06-4f20-8f1f-c490df1a3692 req-64e46196-942b-4b86-a44a-b73fc4da749d admin admin] 10.222.0.58 "DELETE /compute/v2.1/os-assisted-volume-snapshots/af9eab3a-ae78-4e8c-8045-e0c460805867?delete_info=%7B%22file_to_merge%22:%20%22volume-4adfb3fc-0236-45dc-a5b9-1e3c07a57b4b.af9eab3a-ae78-4e8c-8045-e0c460805867.vhdx%22,%20%22volume_id%22:%20%224adfb3fc-0236-45dc-a5b9-1e3c07a57b4b%22%7D" status: 204 len: 0 microversion: 2.1 time: 0.087166 Oct 28 09:48:37.910284 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 170/343] 10.222.0.58 () {62 vars in 1800 bytes} [Fri Oct 28 09:48:37 2022] DELETE /compute/v2.1/os-assisted-volume-snapshots/af9eab3a-ae78-4e8c-8045-e0c460805867?delete_info=%7B%22file_to_merge%22:%20%22volume-4adfb3fc-0236-45dc-a5b9-1e3c07a57b4b.af9eab3a-ae78-4e8c-8045-e0c460805867.vhdx%22,%20%22volume_id%22:%20%224adfb3fc-0236-45dc-a5b9-1e3c07a57b4b%22%7D => generated 0 bytes in 89 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 09:48:38.080518 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-e6e79aaf-75ba-4f4d-81da-020974d15290 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:38.081666 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-e6e79aaf-75ba-4f4d-81da-020974d15290 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 6869ffb6-ce4f-4a91-b8d9-7765ea56e95a] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:38.093629 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-e6e79aaf-75ba-4f4d-81da-020974d15290 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:38.094511 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-e6e79aaf-75ba-4f4d-81da-020974d15290 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:38.095305 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-e6e79aaf-75ba-4f4d-81da-020974d15290 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:38.096608 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-e6e79aaf-75ba-4f4d-81da-020974d15290 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:38.097458 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-e6e79aaf-75ba-4f4d-81da-020974d15290 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:38.098233 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-e6e79aaf-75ba-4f4d-81da-020974d15290 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:38.237550 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [req-8c11357f-4ec4-4405-9322-15981bebeff6 req-40b1452d-253b-41af-b6f3-8e5d5622e221 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ab20f71-d81e-4b6a-90f0-e4b0873c0469", "name": "network-vif-deleted", "tag": "71eb0d61-47d4-42f9-ac21-8a556e555dae"}]} {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:48:38.248719 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-8c11357f-4ec4-4405-9322-15981bebeff6 req-40b1452d-253b-41af-b6f3-8e5d5622e221 service nova] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:38.249200 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-8c11357f-4ec4-4405-9322-15981bebeff6 req-40b1452d-253b-41af-b6f3-8e5d5622e221 service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:38.249637 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-8c11357f-4ec4-4405-9322-15981bebeff6 req-40b1452d-253b-41af-b6f3-8e5d5622e221 service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:38.264954 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.compute.server_external_events [req-8c11357f-4ec4-4405-9322-15981bebeff6 req-40b1452d-253b-41af-b6f3-8e5d5622e221 service nova] Creating event network-vif-deleted:71eb0d61-47d4-42f9-ac21-8a556e555dae for instance 7ab20f71-d81e-4b6a-90f0-e4b0873c0469 on hv-cinder-zed-3 Oct 28 09:48:38.271533 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [req-8c11357f-4ec4-4405-9322-15981bebeff6 req-40b1452d-253b-41af-b6f3-8e5d5622e221 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041062 Oct 28 09:48:38.272541 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 171/344] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Oct 28 09:48:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 09:48:38.279820 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-27e5f28e-bb24-487b-9789-f015ace38e7c tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:38.280478 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-e6e79aaf-75ba-4f4d-81da-020974d15290 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:38.280613 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-27e5f28e-bb24-487b-9789-f015ace38e7c tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] [instance: 0e97301c-3a01-452d-b54a-6bf66c4793d9] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:38.286799 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-27e5f28e-bb24-487b-9789-f015ace38e7c tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:38.287295 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-27e5f28e-bb24-487b-9789-f015ace38e7c tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:38.287723 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-27e5f28e-bb24-487b-9789-f015ace38e7c tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:38.288469 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-27e5f28e-bb24-487b-9789-f015ace38e7c tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:38.288921 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-27e5f28e-bb24-487b-9789-f015ace38e7c tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:38.289343 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-27e5f28e-bb24-487b-9789-f015ace38e7c tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:38.290440 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-e6e79aaf-75ba-4f4d-81da-020974d15290 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:38.292052 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-e6e79aaf-75ba-4f4d-81da-020974d15290 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:38.293254 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-e6e79aaf-75ba-4f4d-81da-020974d15290 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a" status: 200 len: 1720 microversion: 2.20 time: 0.220706 Oct 28 09:48:38.293821 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 174/345] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:48:38 2022] GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a => generated 1720 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:48:38.304882 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.wsgi [None req-27e5f28e-bb24-487b-9789-f015ace38e7c tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] HTTP exception thrown: Instance 0e97301c-3a01-452d-b54a-6bf66c4793d9 could not be found. Oct 28 09:48:38.306588 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-27e5f28e-bb24-487b-9789-f015ace38e7c tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Request method failure captured: Oct 28 09:48:38.306588 dv-cinder-zed-3-smb devstack@n-api.service[127033]: request: GET /compute/v2.1/servers/0e97301c-3a01-452d-b54a-6bf66c4793d9 HTTP/1.1 Oct 28 09:48:38.306588 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Accept: application/json Oct 28 09:48:38.306588 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Accept-Encoding: identity Oct 28 09:48:38.306588 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Connection: close Oct 28 09:48:38.306588 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Content-Length: 0 Oct 28 09:48:38.306588 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Content-Type: application/json Oct 28 09:48:38.306588 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Host: 10.222.0.52 Oct 28 09:48:38.306588 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Openstack-System-Scope: None Oct 28 09:48:38.306588 dv-cinder-zed-3-smb devstack@n-api.service[127033]: User-Agent: python-urllib3/1.26.12 Oct 28 09:48:38.306588 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Auth-Token: gAAAAABjW6VLb6EBITV9bHp6A2GJk-hzUdEQ9_G8nPBfUTKUnilpPDOdUpEvXSY3kDYY3yrYt4ZeCzUSgx1omprydhhQ5Pbu4pBGgGfmPzT_0S7ENz9VEhuh5orQHSvad9tnz3nfx-XnWQoueUl7vx44mrsF6VEaG1T5qDIX7am22gViUnHs3X8 Oct 28 09:48:38.306588 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Domain-Id: None Oct 28 09:48:38.306588 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Domain-Name: None Oct 28 09:48:38.306588 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Identity-Status: Confirmed Oct 28 09:48:38.306588 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Is-Admin-Project: True Oct 28 09:48:38.306588 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Project-Domain-Id: default Oct 28 09:48:38.306588 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Project-Domain-Name: Default Oct 28 09:48:38.306588 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Project-Id: 2aa6bd99403b4421acb8bd714c9450c6 Oct 28 09:48:38.306588 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Project-Name: tempest-VolumesActionsTest-397101613 Oct 28 09:48:38.306588 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Role: reader,member Oct 28 09:48:38.306588 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Roles: reader,member Oct 28 09:48:38.308206 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2aa6bd99403b4421acb8bd714c9450c6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2aa6bd99403b4421acb8bd714c9450c6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2aa6bd99403b4421acb8bd714c9450c6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2aa6bd99403b4421acb8bd714c9450c6"}]}] Oct 28 09:48:38.308206 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Tenant: tempest-VolumesActionsTest-397101613 Oct 28 09:48:38.308206 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Tenant-Id: 2aa6bd99403b4421acb8bd714c9450c6 Oct 28 09:48:38.308206 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Tenant-Name: tempest-VolumesActionsTest-397101613 Oct 28 09:48:38.308206 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User: tempest-VolumesActionsTest-397101613-project Oct 28 09:48:38.308206 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User-Domain-Id: default Oct 28 09:48:38.308206 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User-Domain-Name: Default Oct 28 09:48:38.308206 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User-Id: d10c1b55b5c04ba380ed8ffdaa462bc7 Oct 28 09:48:38.308206 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User-Name: tempest-VolumesActionsTest-397101613-project Oct 28 09:48:38.308206 dv-cinder-zed-3-smb devstack@n-api.service[127033]: method: > Oct 28 09:48:38.308206 dv-cinder-zed-3-smb devstack@n-api.service[127033]: exception: Instance 0e97301c-3a01-452d-b54a-6bf66c4793d9 could not be found. Oct 28 09:48:38.308206 dv-cinder-zed-3-smb devstack@n-api.service[127033]: action_args: {'id': '0e97301c-3a01-452d-b54a-6bf66c4793d9'} Oct 28 09:48:38.309218 dv-cinder-zed-3-smb devstack@n-api.service[127033]: {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:48:38.309218 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:48:38.309218 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 09:48:38.309218 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 09:48:38.309218 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 09:48:38.309218 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 09:48:38.309218 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 09:48:38.309218 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 09:48:38.309218 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 09:48:38.309218 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 09:48:38.309218 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e97301c-3a01-452d-b54a-6bf66c4793d9 could not be found. Oct 28 09:48:38.309218 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:48:38.309218 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:48:38.309218 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:48:38.309218 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:48:38.309218 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:48:38.309218 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:48:38.309218 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:48:38.309218 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:48:38.309218 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:48:38.310528 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:48:38.310528 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 09:48:38.310528 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 09:48:38.310528 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 09:48:38.310528 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 09:48:38.310528 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 09:48:38.310528 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 09:48:38.310528 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e97301c-3a01-452d-b54a-6bf66c4793d9 could not be found. Oct 28 09:48:38.310528 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:48:38.310528 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:48:38.310528 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:48:38.310528 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:48:38.310528 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:48:38.310528 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:48:38.310528 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:48:38.310528 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:48:38.310528 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e97301c-3a01-452d-b54a-6bf66c4793d9 could not be found. Oct 28 09:48:38.310528 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:48:38.311776 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-27e5f28e-bb24-487b-9789-f015ace38e7c tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Returning 404 to user: Instance 0e97301c-3a01-452d-b54a-6bf66c4793d9 could not be found. {{(pid=127033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:48:38.311776 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-27e5f28e-bb24-487b-9789-f015ace38e7c tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] 10.222.0.52 "GET /compute/v2.1/servers/0e97301c-3a01-452d-b54a-6bf66c4793d9" status: 404 len: 111 microversion: 2.1 time: 0.034072 Oct 28 09:48:38.311776 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 172/346] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:48:38 2022] GET /compute/v2.1/servers/0e97301c-3a01-452d-b54a-6bf66c4793d9 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:48:38.330239 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-8d9ac115-8f62-4e29-96bb-468d69d9f953 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:38.330841 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-8d9ac115-8f62-4e29-96bb-468d69d9f953 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] [instance: 91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:38.337568 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-8d9ac115-8f62-4e29-96bb-468d69d9f953 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:38.338049 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-8d9ac115-8f62-4e29-96bb-468d69d9f953 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:38.338475 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-8d9ac115-8f62-4e29-96bb-468d69d9f953 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:38.339170 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-8d9ac115-8f62-4e29-96bb-468d69d9f953 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:38.339618 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-8d9ac115-8f62-4e29-96bb-468d69d9f953 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:38.340078 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-8d9ac115-8f62-4e29-96bb-468d69d9f953 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:38.415820 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-93934e2a-5dda-46b9-a213-5631db9ab251 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-962582447", "imageRef": "6e314146-a2ed-4f8b-afdd-4f7ed1184d20", "flavorRef": "452", "networks": [{"uuid": "c90d134e-a442-4b9c-99a6-a23ffbc80806"}]}} {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:48:38.470920 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.network.neutron [None req-93934e2a-5dda-46b9-a213-5631db9ab251 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] validate_networks() for [('c90d134e-a442-4b9c-99a6-a23ffbc80806', None, None, None, None, None)] {{(pid=127033) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 09:48:38.471528 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-8d9ac115-8f62-4e29-96bb-468d69d9f953 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bee2d5f599642788c32e0d8b8338c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e7d531c0f4a33a869309af965e3e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:38.480877 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-8d9ac115-8f62-4e29-96bb-468d69d9f953 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] 10.222.0.52 "GET /compute/v2.1/servers/91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1" status: 200 len: 1722 microversion: 2.1 time: 0.154458 Oct 28 09:48:38.494581 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 175/347] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:48:38 2022] GET /compute/v2.1/servers/91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:48:38.558374 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-5d05e21e-d2a7-4174-87a4-c7920340fda9 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:38.558972 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-5d05e21e-d2a7-4174-87a4-c7920340fda9 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] [instance: 7ab20f71-d81e-4b6a-90f0-e4b0873c0469] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:38.564877 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-5d05e21e-d2a7-4174-87a4-c7920340fda9 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:38.565292 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-5d05e21e-d2a7-4174-87a4-c7920340fda9 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:38.565719 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-5d05e21e-d2a7-4174-87a4-c7920340fda9 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:38.566400 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-5d05e21e-d2a7-4174-87a4-c7920340fda9 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:38.566845 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-5d05e21e-d2a7-4174-87a4-c7920340fda9 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:38.567256 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-5d05e21e-d2a7-4174-87a4-c7920340fda9 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:38.638313 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-5d05e21e-d2a7-4174-87a4-c7920340fda9 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05718633def4ad6822728767580b810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89c15d74a584be3b5e44f74ed50eea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:38.645959 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-5d05e21e-d2a7-4174-87a4-c7920340fda9 tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] 10.222.0.52 "GET /compute/v2.1/servers/7ab20f71-d81e-4b6a-90f0-e4b0873c0469" status: 200 len: 1427 microversion: 2.1 time: 0.091419 Oct 28 09:48:38.646525 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 176/348] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:48:38 2022] GET /compute/v2.1/servers/7ab20f71-d81e-4b6a-90f0-e4b0873c0469 => generated 1427 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:48:38.651601 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-ee07db5e-eec4-41eb-bf11-8c7e39a820b0 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:38.652223 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-ee07db5e-eec4-41eb-bf11-8c7e39a820b0 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: e6ddb7f9-7854-4aa1-a174-2048b9a40431] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:38.660264 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ee07db5e-eec4-41eb-bf11-8c7e39a820b0 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:38.660859 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ee07db5e-eec4-41eb-bf11-8c7e39a820b0 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:38.661427 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ee07db5e-eec4-41eb-bf11-8c7e39a820b0 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:38.662273 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ee07db5e-eec4-41eb-bf11-8c7e39a820b0 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:38.662768 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ee07db5e-eec4-41eb-bf11-8c7e39a820b0 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:38.663259 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ee07db5e-eec4-41eb-bf11-8c7e39a820b0 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:38.738631 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-ee07db5e-eec4-41eb-bf11-8c7e39a820b0 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe6eb38e8df492daaef5755ddea7773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234f69f21d7a456a9ab6a86c4ac2ede2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:38.747759 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-ee07db5e-eec4-41eb-bf11-8c7e39a820b0 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] 10.222.0.52 "GET /compute/v2.1/servers/e6ddb7f9-7854-4aa1-a174-2048b9a40431" status: 200 len: 1297 microversion: 2.1 time: 0.100217 Oct 28 09:48:38.748941 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 177/349] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:48:38 2022] GET /compute/v2.1/servers/e6ddb7f9-7854-4aa1-a174-2048b9a40431 => generated 1297 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:48:38.864844 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.virt.hardware [None req-93934e2a-5dda-46b9-a213-5631db9ab251 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Flavor limits 0:0:0 {{(pid=127033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 09:48:38.865265 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.virt.hardware [None req-93934e2a-5dda-46b9-a213-5631db9ab251 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Image limits 0:0:0 {{(pid=127033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 09:48:38.865763 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.virt.hardware [None req-93934e2a-5dda-46b9-a213-5631db9ab251 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Flavor pref 0:0:0 {{(pid=127033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 09:48:38.866194 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.virt.hardware [None req-93934e2a-5dda-46b9-a213-5631db9ab251 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Image pref 0:0:0 {{(pid=127033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 09:48:38.866601 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.virt.hardware [None req-93934e2a-5dda-46b9-a213-5631db9ab251 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 09:48:38.875834 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-93934e2a-5dda-46b9-a213-5631db9ab251 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:38.876311 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-93934e2a-5dda-46b9-a213-5631db9ab251 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:38.876737 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-93934e2a-5dda-46b9-a213-5631db9ab251 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:38.877481 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-93934e2a-5dda-46b9-a213-5631db9ab251 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:38.877931 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-93934e2a-5dda-46b9-a213-5631db9ab251 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:38.878351 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-93934e2a-5dda-46b9-a213-5631db9ab251 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:38.895842 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.quota [None req-93934e2a-5dda-46b9-a213-5631db9ab251 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Getting quotas for project 2aa6bd99403b4421acb8bd714c9450c6. Resources: {'cores', 'ram', 'instances'} {{(pid=127033) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 09:48:38.899728 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.quota [None req-93934e2a-5dda-46b9-a213-5631db9ab251 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Getting quotas for user d10c1b55b5c04ba380ed8ffdaa462bc7 and project 2aa6bd99403b4421acb8bd714c9450c6. Resources: {'cores', 'ram', 'instances'} {{(pid=127033) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 09:48:38.910513 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-93934e2a-5dda-46b9-a213-5631db9ab251 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Going to run 1 instances... {{(pid=127033) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 09:48:38.912810 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-93934e2a-5dda-46b9-a213-5631db9ab251 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] [instance: 525c3586-feef-45c3-a507-eed1ab960107] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e314146-a2ed-4f8b-afdd-4f7ed1184d20',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127033) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 09:48:38.959912 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-93934e2a-5dda-46b9-a213-5631db9ab251 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.548498 Oct 28 09:48:38.960555 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 173/350] 10.222.0.52 () {60 vars in 1147 bytes} [Fri Oct 28 09:48:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 550 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 28 09:48:38.972401 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-e24ddd93-5cd9-4fc1-b4da-2f6b1a143c3b tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:38.973119 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-e24ddd93-5cd9-4fc1-b4da-2f6b1a143c3b tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] [instance: 525c3586-feef-45c3-a507-eed1ab960107] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:39.026242 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-e24ddd93-5cd9-4fc1-b4da-2f6b1a143c3b tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c1b55b5c04ba380ed8ffdaa462bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa6bd99403b4421acb8bd714c9450c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:39.033281 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-e24ddd93-5cd9-4fc1-b4da-2f6b1a143c3b tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] 10.222.0.52 "GET /compute/v2.1/servers/525c3586-feef-45c3-a507-eed1ab960107" status: 200 len: 1213 microversion: 2.1 time: 0.064666 Oct 28 09:48:39.034109 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 178/351] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:48:38 2022] GET /compute/v2.1/servers/525c3586-feef-45c3-a507-eed1ab960107 => generated 1213 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:48:39.319039 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-ab17ce32-f862-4c8a-b280-f206fff39485 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:39.322022 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-ab17ce32-f862-4c8a-b280-f206fff39485 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 6869ffb6-ce4f-4a91-b8d9-7765ea56e95a] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:39.330932 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-ab17ce32-f862-4c8a-b280-f206fff39485 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:39.331706 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-ab17ce32-f862-4c8a-b280-f206fff39485 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:39.332525 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-ab17ce32-f862-4c8a-b280-f206fff39485 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:39.333386 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-ab17ce32-f862-4c8a-b280-f206fff39485 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:39.334415 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-ab17ce32-f862-4c8a-b280-f206fff39485 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:39.336107 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-ab17ce32-f862-4c8a-b280-f206fff39485 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:39.488035 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-ab17ce32-f862-4c8a-b280-f206fff39485 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:39.497794 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-ab17ce32-f862-4c8a-b280-f206fff39485 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:39.504082 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-98e3b4de-df15-4e9d-b388-10840002b521 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:39.505244 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-98e3b4de-df15-4e9d-b388-10840002b521 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] [instance: 91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:39.507896 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-ab17ce32-f862-4c8a-b280-f206fff39485 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:39.510143 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-ab17ce32-f862-4c8a-b280-f206fff39485 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a" status: 200 len: 1720 microversion: 2.20 time: 0.195009 Oct 28 09:48:39.510695 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 174/352] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:48:39 2022] GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a => generated 1720 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:48:39.516849 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-98e3b4de-df15-4e9d-b388-10840002b521 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:39.517523 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-98e3b4de-df15-4e9d-b388-10840002b521 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:39.518102 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-98e3b4de-df15-4e9d-b388-10840002b521 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:39.518973 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-98e3b4de-df15-4e9d-b388-10840002b521 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:39.519723 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-98e3b4de-df15-4e9d-b388-10840002b521 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:39.520415 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-98e3b4de-df15-4e9d-b388-10840002b521 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:39.664772 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-98e3b4de-df15-4e9d-b388-10840002b521 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bee2d5f599642788c32e0d8b8338c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e7d531c0f4a33a869309af965e3e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:39.670172 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-287c07ec-d77b-4f31-b927-8ba4352b5eac tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:39.671017 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-287c07ec-d77b-4f31-b927-8ba4352b5eac tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] [instance: 7ab20f71-d81e-4b6a-90f0-e4b0873c0469] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:39.673742 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-98e3b4de-df15-4e9d-b388-10840002b521 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] 10.222.0.52 "GET /compute/v2.1/servers/91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1" status: 200 len: 1722 microversion: 2.1 time: 0.173393 Oct 28 09:48:39.674623 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 179/353] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:48:39 2022] GET /compute/v2.1/servers/91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1 => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:48:39.682047 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-287c07ec-d77b-4f31-b927-8ba4352b5eac tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:39.682638 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-287c07ec-d77b-4f31-b927-8ba4352b5eac tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:39.683336 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-287c07ec-d77b-4f31-b927-8ba4352b5eac tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:39.684163 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-287c07ec-d77b-4f31-b927-8ba4352b5eac tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:39.684814 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-287c07ec-d77b-4f31-b927-8ba4352b5eac tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:39.685412 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-287c07ec-d77b-4f31-b927-8ba4352b5eac tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:39.717265 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-287c07ec-d77b-4f31-b927-8ba4352b5eac tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:39.717776 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-287c07ec-d77b-4f31-b927-8ba4352b5eac tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:39.718190 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-287c07ec-d77b-4f31-b927-8ba4352b5eac tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:39.718762 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.objects.instance [None req-287c07ec-d77b-4f31-b927-8ba4352b5eac tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Lazy-loading 'fault' on Instance uuid 7ab20f71-d81e-4b6a-90f0-e4b0873c0469 {{(pid=127033) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:48:39.766458 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-287c07ec-d77b-4f31-b927-8ba4352b5eac tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05718633def4ad6822728767580b810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89c15d74a584be3b5e44f74ed50eea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:39.776841 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-80981651-28ab-4267-be1b-b7915b480964 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:39.777679 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-80981651-28ab-4267-be1b-b7915b480964 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: e6ddb7f9-7854-4aa1-a174-2048b9a40431] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:39.781294 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-287c07ec-d77b-4f31-b927-8ba4352b5eac tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] 10.222.0.52 "GET /compute/v2.1/servers/7ab20f71-d81e-4b6a-90f0-e4b0873c0469" status: 200 len: 1305 microversion: 2.1 time: 0.114947 Oct 28 09:48:39.784403 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-80981651-28ab-4267-be1b-b7915b480964 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:39.785309 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-80981651-28ab-4267-be1b-b7915b480964 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:39.785957 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-80981651-28ab-4267-be1b-b7915b480964 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:39.786854 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-80981651-28ab-4267-be1b-b7915b480964 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:39.787735 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-80981651-28ab-4267-be1b-b7915b480964 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:39.788223 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-80981651-28ab-4267-be1b-b7915b480964 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:39.797169 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 175/354] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:48:39 2022] GET /compute/v2.1/servers/7ab20f71-d81e-4b6a-90f0-e4b0873c0469 => generated 1305 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:48:39.871320 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-80981651-28ab-4267-be1b-b7915b480964 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe6eb38e8df492daaef5755ddea7773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234f69f21d7a456a9ab6a86c4ac2ede2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:39.879806 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-80981651-28ab-4267-be1b-b7915b480964 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] 10.222.0.52 "GET /compute/v2.1/servers/e6ddb7f9-7854-4aa1-a174-2048b9a40431" status: 200 len: 1303 microversion: 2.1 time: 0.107220 Oct 28 09:48:39.884261 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 180/355] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:48:39 2022] GET /compute/v2.1/servers/e6ddb7f9-7854-4aa1-a174-2048b9a40431 => generated 1303 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:48:40.057167 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-626fc1f6-a095-4d64-a86a-dcb8547360d3 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:40.057994 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-626fc1f6-a095-4d64-a86a-dcb8547360d3 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] [instance: 525c3586-feef-45c3-a507-eed1ab960107] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:40.065274 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-626fc1f6-a095-4d64-a86a-dcb8547360d3 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:40.066069 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-626fc1f6-a095-4d64-a86a-dcb8547360d3 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:40.066571 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-626fc1f6-a095-4d64-a86a-dcb8547360d3 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:40.067452 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-626fc1f6-a095-4d64-a86a-dcb8547360d3 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:40.067946 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-626fc1f6-a095-4d64-a86a-dcb8547360d3 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:40.068558 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-626fc1f6-a095-4d64-a86a-dcb8547360d3 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:40.140485 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-626fc1f6-a095-4d64-a86a-dcb8547360d3 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c1b55b5c04ba380ed8ffdaa462bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa6bd99403b4421acb8bd714c9450c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:40.148580 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-626fc1f6-a095-4d64-a86a-dcb8547360d3 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] 10.222.0.52 "GET /compute/v2.1/servers/525c3586-feef-45c3-a507-eed1ab960107" status: 200 len: 1209 microversion: 2.1 time: 0.095393 Oct 28 09:48:40.149229 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 176/356] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:48:40 2022] GET /compute/v2.1/servers/525c3586-feef-45c3-a507-eed1ab960107 => generated 1209 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:48:40.538550 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-e60f3817-efba-4bc6-9aaa-e796eb3fc0b2 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:40.539153 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-e60f3817-efba-4bc6-9aaa-e796eb3fc0b2 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 6869ffb6-ce4f-4a91-b8d9-7765ea56e95a] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:40.545636 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-e60f3817-efba-4bc6-9aaa-e796eb3fc0b2 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:40.546116 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-e60f3817-efba-4bc6-9aaa-e796eb3fc0b2 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:40.546547 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-e60f3817-efba-4bc6-9aaa-e796eb3fc0b2 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:40.547235 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-e60f3817-efba-4bc6-9aaa-e796eb3fc0b2 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:40.547684 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-e60f3817-efba-4bc6-9aaa-e796eb3fc0b2 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:40.548132 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-e60f3817-efba-4bc6-9aaa-e796eb3fc0b2 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:40.675372 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-e60f3817-efba-4bc6-9aaa-e796eb3fc0b2 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:40.683913 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-e60f3817-efba-4bc6-9aaa-e796eb3fc0b2 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:40.685344 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-e60f3817-efba-4bc6-9aaa-e796eb3fc0b2 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:40.686488 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-e60f3817-efba-4bc6-9aaa-e796eb3fc0b2 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a" status: 200 len: 1720 microversion: 2.20 time: 0.152909 Oct 28 09:48:40.687042 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 181/357] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:48:40 2022] GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a => generated 1720 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:48:40.698089 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-80c19224-c66f-436e-94f0-879bf10d8121 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:40.698686 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-80c19224-c66f-436e-94f0-879bf10d8121 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] [instance: 91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:40.705140 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-80c19224-c66f-436e-94f0-879bf10d8121 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:40.705619 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-80c19224-c66f-436e-94f0-879bf10d8121 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:40.706049 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-80c19224-c66f-436e-94f0-879bf10d8121 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:40.706731 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-80c19224-c66f-436e-94f0-879bf10d8121 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:40.707183 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-80c19224-c66f-436e-94f0-879bf10d8121 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:40.707603 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-80c19224-c66f-436e-94f0-879bf10d8121 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:40.810917 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-32979cd4-6404-4107-9c2f-ebda2330c3cc tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:40.812018 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-32979cd4-6404-4107-9c2f-ebda2330c3cc tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] [instance: 7ab20f71-d81e-4b6a-90f0-e4b0873c0469] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:40.819411 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-32979cd4-6404-4107-9c2f-ebda2330c3cc tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:40.820143 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-32979cd4-6404-4107-9c2f-ebda2330c3cc tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:40.820756 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-32979cd4-6404-4107-9c2f-ebda2330c3cc tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:40.822253 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-32979cd4-6404-4107-9c2f-ebda2330c3cc tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:40.822923 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-32979cd4-6404-4107-9c2f-ebda2330c3cc tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:40.823797 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-32979cd4-6404-4107-9c2f-ebda2330c3cc tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:40.855580 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-80c19224-c66f-436e-94f0-879bf10d8121 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bee2d5f599642788c32e0d8b8338c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e7d531c0f4a33a869309af965e3e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:40.866938 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-80c19224-c66f-436e-94f0-879bf10d8121 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] 10.222.0.52 "GET /compute/v2.1/servers/91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1" status: 200 len: 1722 microversion: 2.1 time: 0.172830 Oct 28 09:48:40.870433 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 177/358] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:48:40 2022] GET /compute/v2.1/servers/91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1 => generated 1722 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:48:40.907799 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-1f42b925-65f5-420b-a4c0-70b2b82d3e17 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:40.908442 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-1f42b925-65f5-420b-a4c0-70b2b82d3e17 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: e6ddb7f9-7854-4aa1-a174-2048b9a40431] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:40.914102 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-32979cd4-6404-4107-9c2f-ebda2330c3cc tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:40.915235 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-32979cd4-6404-4107-9c2f-ebda2330c3cc tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:40.915791 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-32979cd4-6404-4107-9c2f-ebda2330c3cc tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:40.916319 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.objects.instance [None req-32979cd4-6404-4107-9c2f-ebda2330c3cc tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Lazy-loading 'fault' on Instance uuid 7ab20f71-d81e-4b6a-90f0-e4b0873c0469 {{(pid=127032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:48:40.920472 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-1f42b925-65f5-420b-a4c0-70b2b82d3e17 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:40.922908 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-1f42b925-65f5-420b-a4c0-70b2b82d3e17 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:40.923897 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-1f42b925-65f5-420b-a4c0-70b2b82d3e17 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:40.925211 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-1f42b925-65f5-420b-a4c0-70b2b82d3e17 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:40.928595 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-1f42b925-65f5-420b-a4c0-70b2b82d3e17 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:40.929312 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-1f42b925-65f5-420b-a4c0-70b2b82d3e17 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:40.965826 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-32979cd4-6404-4107-9c2f-ebda2330c3cc tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05718633def4ad6822728767580b810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89c15d74a584be3b5e44f74ed50eea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:40.974851 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-32979cd4-6404-4107-9c2f-ebda2330c3cc tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] 10.222.0.52 "GET /compute/v2.1/servers/7ab20f71-d81e-4b6a-90f0-e4b0873c0469" status: 200 len: 1305 microversion: 2.1 time: 0.170407 Oct 28 09:48:40.988141 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 182/359] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:48:40 2022] GET /compute/v2.1/servers/7ab20f71-d81e-4b6a-90f0-e4b0873c0469 => generated 1305 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:48:41.074474 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-1f42b925-65f5-420b-a4c0-70b2b82d3e17 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe6eb38e8df492daaef5755ddea7773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234f69f21d7a456a9ab6a86c4ac2ede2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:41.082137 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-1f42b925-65f5-420b-a4c0-70b2b82d3e17 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] 10.222.0.52 "GET /compute/v2.1/servers/e6ddb7f9-7854-4aa1-a174-2048b9a40431" status: 200 len: 1371 microversion: 2.1 time: 0.180242 Oct 28 09:48:41.082717 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 178/360] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:48:40 2022] GET /compute/v2.1/servers/e6ddb7f9-7854-4aa1-a174-2048b9a40431 => generated 1371 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:48:41.172540 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-7cdaa77a-29dd-4208-890a-047c94da1ccf tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:41.173149 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-7cdaa77a-29dd-4208-890a-047c94da1ccf tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] [instance: 525c3586-feef-45c3-a507-eed1ab960107] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:41.178891 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-7cdaa77a-29dd-4208-890a-047c94da1ccf tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:41.179373 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-7cdaa77a-29dd-4208-890a-047c94da1ccf tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:41.179837 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-7cdaa77a-29dd-4208-890a-047c94da1ccf tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:41.181079 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-7cdaa77a-29dd-4208-890a-047c94da1ccf tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:41.181537 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-7cdaa77a-29dd-4208-890a-047c94da1ccf tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:41.181959 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-7cdaa77a-29dd-4208-890a-047c94da1ccf tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:41.246830 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-7cdaa77a-29dd-4208-890a-047c94da1ccf tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c1b55b5c04ba380ed8ffdaa462bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa6bd99403b4421acb8bd714c9450c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:41.249055 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG dbcounter [-] [127032] Writing DB stats nova_cell1:SELECT=100 {{(pid=127032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:48:41.256000 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-7cdaa77a-29dd-4208-890a-047c94da1ccf tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] 10.222.0.52 "GET /compute/v2.1/servers/525c3586-feef-45c3-a507-eed1ab960107" status: 200 len: 1265 microversion: 2.1 time: 0.087272 Oct 28 09:48:41.256733 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 183/361] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:48:41 2022] GET /compute/v2.1/servers/525c3586-feef-45c3-a507-eed1ab960107 => generated 1265 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:48:41.496647 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [req-837b4bbd-a3ca-489f-9204-34580d054ae8 req-7c9a5b17-7d7c-4ee2-94c0-9686818d531c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6ddb7f9-7854-4aa1-a174-2048b9a40431", "tag": "02ec0bd8-060a-466c-b33b-8ecb3e609c46"}]} {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:48:41.505863 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-837b4bbd-a3ca-489f-9204-34580d054ae8 req-7c9a5b17-7d7c-4ee2-94c0-9686818d531c service nova] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:41.506339 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-837b4bbd-a3ca-489f-9204-34580d054ae8 req-7c9a5b17-7d7c-4ee2-94c0-9686818d531c service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:41.506887 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-837b4bbd-a3ca-489f-9204-34580d054ae8 req-7c9a5b17-7d7c-4ee2-94c0-9686818d531c service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:41.518952 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.compute.server_external_events [req-837b4bbd-a3ca-489f-9204-34580d054ae8 req-7c9a5b17-7d7c-4ee2-94c0-9686818d531c service nova] Creating event network-changed:02ec0bd8-060a-466c-b33b-8ecb3e609c46 for instance e6ddb7f9-7854-4aa1-a174-2048b9a40431 on hv-cinder-zed-3 Oct 28 09:48:41.523569 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [req-837b4bbd-a3ca-489f-9204-34580d054ae8 req-7c9a5b17-7d7c-4ee2-94c0-9686818d531c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031173 Oct 28 09:48:41.524249 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 179/362] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Oct 28 09:48:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:48:41.712858 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-92f5a08c-92ac-4c4e-b1b3-619fe75ccffd tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:41.713498 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-92f5a08c-92ac-4c4e-b1b3-619fe75ccffd tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 6869ffb6-ce4f-4a91-b8d9-7765ea56e95a] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:41.720257 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-92f5a08c-92ac-4c4e-b1b3-619fe75ccffd tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:41.720751 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-92f5a08c-92ac-4c4e-b1b3-619fe75ccffd tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:41.721186 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-92f5a08c-92ac-4c4e-b1b3-619fe75ccffd tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:41.721919 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-92f5a08c-92ac-4c4e-b1b3-619fe75ccffd tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:41.722374 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-92f5a08c-92ac-4c4e-b1b3-619fe75ccffd tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:41.722797 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-92f5a08c-92ac-4c4e-b1b3-619fe75ccffd tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:41.861145 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-92f5a08c-92ac-4c4e-b1b3-619fe75ccffd tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:41.869313 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-92f5a08c-92ac-4c4e-b1b3-619fe75ccffd tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:41.870766 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-92f5a08c-92ac-4c4e-b1b3-619fe75ccffd tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:41.871956 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-92f5a08c-92ac-4c4e-b1b3-619fe75ccffd tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a" status: 200 len: 1720 microversion: 2.20 time: 0.163261 Oct 28 09:48:41.872515 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 184/363] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:48:41 2022] GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a => generated 1720 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:48:41.898209 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-c4ae620c-6e51-4a0f-95b4-5711c7aeb97f tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:41.898957 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-c4ae620c-6e51-4a0f-95b4-5711c7aeb97f tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] [instance: 91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:41.905750 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-c4ae620c-6e51-4a0f-95b4-5711c7aeb97f tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:41.906237 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-c4ae620c-6e51-4a0f-95b4-5711c7aeb97f tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:41.906758 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-c4ae620c-6e51-4a0f-95b4-5711c7aeb97f tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:41.907495 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-c4ae620c-6e51-4a0f-95b4-5711c7aeb97f tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:41.907976 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-c4ae620c-6e51-4a0f-95b4-5711c7aeb97f tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:41.908409 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-c4ae620c-6e51-4a0f-95b4-5711c7aeb97f tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:41.999250 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-702b0845-6a1f-4398-8006-49e847145a5e tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:42.000001 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-702b0845-6a1f-4398-8006-49e847145a5e tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] [instance: 7ab20f71-d81e-4b6a-90f0-e4b0873c0469] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:42.005978 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-702b0845-6a1f-4398-8006-49e847145a5e tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:42.006460 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-702b0845-6a1f-4398-8006-49e847145a5e tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:42.006942 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-702b0845-6a1f-4398-8006-49e847145a5e tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:42.007804 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-702b0845-6a1f-4398-8006-49e847145a5e tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:42.008318 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-702b0845-6a1f-4398-8006-49e847145a5e tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:42.008761 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-702b0845-6a1f-4398-8006-49e847145a5e tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:42.022865 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.wsgi [None req-702b0845-6a1f-4398-8006-49e847145a5e tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] HTTP exception thrown: Instance 7ab20f71-d81e-4b6a-90f0-e4b0873c0469 could not be found. Oct 28 09:48:42.025155 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-702b0845-6a1f-4398-8006-49e847145a5e tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Request method failure captured: Oct 28 09:48:42.025155 dv-cinder-zed-3-smb devstack@n-api.service[127032]: request: GET /compute/v2.1/servers/7ab20f71-d81e-4b6a-90f0-e4b0873c0469 HTTP/1.1 Oct 28 09:48:42.025155 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Accept: application/json Oct 28 09:48:42.025155 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Accept-Encoding: identity Oct 28 09:48:42.025155 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Connection: close Oct 28 09:48:42.025155 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Content-Length: 0 Oct 28 09:48:42.025155 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Content-Type: application/json Oct 28 09:48:42.025155 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Host: 10.222.0.52 Oct 28 09:48:42.025155 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Openstack-System-Scope: None Oct 28 09:48:42.025155 dv-cinder-zed-3-smb devstack@n-api.service[127032]: User-Agent: python-urllib3/1.26.12 Oct 28 09:48:42.025155 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Auth-Token: gAAAAABjW6VT-uHxSNXcZ6jrf0mM3FDj7bGuL8D5Wmrrp1O7cXVF2albWEsgII8EFDGUlGKsXmOcmFPHFy7O0X4nImfN69b1P_QjyBrW7OBUtW3G4v5U-g1Z9mAVzrCE5G4UiBJ2BXRaVZAmNo4_jL_gkn72TSUNTZLro66l2NusbAQhskZgcso Oct 28 09:48:42.025155 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Domain-Id: None Oct 28 09:48:42.025155 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Domain-Name: None Oct 28 09:48:42.025155 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Identity-Status: Confirmed Oct 28 09:48:42.025155 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Is-Admin-Project: True Oct 28 09:48:42.025155 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Project-Domain-Id: default Oct 28 09:48:42.025155 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Project-Domain-Name: Default Oct 28 09:48:42.025155 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Project-Id: d89c15d74a584be3b5e44f74ed50eea3 Oct 28 09:48:42.025155 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Project-Name: tempest-VolumesNegativeTest-689050983 Oct 28 09:48:42.025155 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Role: reader,member Oct 28 09:48:42.025155 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Roles: reader,member Oct 28 09:48:42.026673 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d89c15d74a584be3b5e44f74ed50eea3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d89c15d74a584be3b5e44f74ed50eea3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d89c15d74a584be3b5e44f74ed50eea3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d89c15d74a584be3b5e44f74ed50eea3"}]}] Oct 28 09:48:42.026673 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Tenant: tempest-VolumesNegativeTest-689050983 Oct 28 09:48:42.026673 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Tenant-Id: d89c15d74a584be3b5e44f74ed50eea3 Oct 28 09:48:42.026673 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Tenant-Name: tempest-VolumesNegativeTest-689050983 Oct 28 09:48:42.026673 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-User: tempest-VolumesNegativeTest-689050983-project Oct 28 09:48:42.026673 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-User-Domain-Id: default Oct 28 09:48:42.026673 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-User-Domain-Name: Default Oct 28 09:48:42.026673 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-User-Id: c05718633def4ad6822728767580b810 Oct 28 09:48:42.026673 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-User-Name: tempest-VolumesNegativeTest-689050983-project Oct 28 09:48:42.026673 dv-cinder-zed-3-smb devstack@n-api.service[127032]: method: > Oct 28 09:48:42.026673 dv-cinder-zed-3-smb devstack@n-api.service[127032]: exception: Instance 7ab20f71-d81e-4b6a-90f0-e4b0873c0469 could not be found. Oct 28 09:48:42.026673 dv-cinder-zed-3-smb devstack@n-api.service[127032]: action_args: {'id': '7ab20f71-d81e-4b6a-90f0-e4b0873c0469'} Oct 28 09:48:42.027465 dv-cinder-zed-3-smb devstack@n-api.service[127032]: {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:48:42.027465 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:48:42.027465 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 09:48:42.027465 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 09:48:42.027465 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 09:48:42.027465 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 09:48:42.027465 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 09:48:42.027465 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 09:48:42.027465 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 09:48:42.027465 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 09:48:42.027465 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ab20f71-d81e-4b6a-90f0-e4b0873c0469 could not be found. Oct 28 09:48:42.027465 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Oct 28 09:48:42.027465 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:48:42.027465 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Oct 28 09:48:42.027465 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:48:42.027465 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:48:42.027465 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:48:42.027465 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:48:42.027465 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:48:42.027465 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:48:42.028661 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:48:42.028661 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 09:48:42.028661 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 09:48:42.028661 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 09:48:42.028661 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 09:48:42.028661 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 09:48:42.028661 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 09:48:42.028661 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ab20f71-d81e-4b6a-90f0-e4b0873c0469 could not be found. Oct 28 09:48:42.028661 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Oct 28 09:48:42.028661 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:48:42.028661 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Oct 28 09:48:42.028661 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:48:42.028661 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:48:42.028661 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:48:42.028661 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:48:42.028661 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:48:42.028661 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ab20f71-d81e-4b6a-90f0-e4b0873c0469 could not be found. Oct 28 09:48:42.028661 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Oct 28 09:48:42.029686 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-702b0845-6a1f-4398-8006-49e847145a5e tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] Returning 404 to user: Instance 7ab20f71-d81e-4b6a-90f0-e4b0873c0469 could not be found. {{(pid=127032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:48:42.029686 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-702b0845-6a1f-4398-8006-49e847145a5e tempest-VolumesNegativeTest-689050983 tempest-VolumesNegativeTest-689050983-project] 10.222.0.52 "GET /compute/v2.1/servers/7ab20f71-d81e-4b6a-90f0-e4b0873c0469" status: 404 len: 111 microversion: 2.1 time: 0.032000 Oct 28 09:48:42.029686 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 185/364] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:48:41 2022] GET /compute/v2.1/servers/7ab20f71-d81e-4b6a-90f0-e4b0873c0469 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 09:48:42.050109 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-c4ae620c-6e51-4a0f-95b4-5711c7aeb97f tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bee2d5f599642788c32e0d8b8338c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e7d531c0f4a33a869309af965e3e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:42.058914 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-c4ae620c-6e51-4a0f-95b4-5711c7aeb97f tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] 10.222.0.52 "GET /compute/v2.1/servers/91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1" status: 200 len: 1722 microversion: 2.1 time: 0.165465 Oct 28 09:48:42.059478 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 180/365] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:48:41 2022] GET /compute/v2.1/servers/91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:48:42.106333 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-5208e515-6aeb-4352-9d26-332e4276a251 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:42.107504 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-5208e515-6aeb-4352-9d26-332e4276a251 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: e6ddb7f9-7854-4aa1-a174-2048b9a40431] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:42.113518 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-5208e515-6aeb-4352-9d26-332e4276a251 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:42.114005 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-5208e515-6aeb-4352-9d26-332e4276a251 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:42.114464 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-5208e515-6aeb-4352-9d26-332e4276a251 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:42.115205 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-5208e515-6aeb-4352-9d26-332e4276a251 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:42.115659 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-5208e515-6aeb-4352-9d26-332e4276a251 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:42.116111 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-5208e515-6aeb-4352-9d26-332e4276a251 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:42.272253 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-5208e515-6aeb-4352-9d26-332e4276a251 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe6eb38e8df492daaef5755ddea7773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234f69f21d7a456a9ab6a86c4ac2ede2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:42.280737 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-efd006b2-0b0f-4491-8331-76b6131c3687 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:42.281021 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-5208e515-6aeb-4352-9d26-332e4276a251 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] 10.222.0.52 "GET /compute/v2.1/servers/e6ddb7f9-7854-4aa1-a174-2048b9a40431" status: 200 len: 1371 microversion: 2.1 time: 0.179080 Oct 28 09:48:42.281734 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-efd006b2-0b0f-4491-8331-76b6131c3687 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] [instance: 525c3586-feef-45c3-a507-eed1ab960107] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:42.283460 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 186/366] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:48:42 2022] GET /compute/v2.1/servers/e6ddb7f9-7854-4aa1-a174-2048b9a40431 => generated 1371 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:48:42.288345 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-efd006b2-0b0f-4491-8331-76b6131c3687 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:42.289096 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-efd006b2-0b0f-4491-8331-76b6131c3687 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:42.289773 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-efd006b2-0b0f-4491-8331-76b6131c3687 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:42.290631 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-efd006b2-0b0f-4491-8331-76b6131c3687 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:42.291269 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-efd006b2-0b0f-4491-8331-76b6131c3687 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:42.291914 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-efd006b2-0b0f-4491-8331-76b6131c3687 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:42.364035 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-efd006b2-0b0f-4491-8331-76b6131c3687 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c1b55b5c04ba380ed8ffdaa462bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa6bd99403b4421acb8bd714c9450c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:42.372444 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-efd006b2-0b0f-4491-8331-76b6131c3687 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] 10.222.0.52 "GET /compute/v2.1/servers/525c3586-feef-45c3-a507-eed1ab960107" status: 200 len: 1265 microversion: 2.1 time: 0.095670 Oct 28 09:48:42.373081 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 181/367] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:48:42 2022] GET /compute/v2.1/servers/525c3586-feef-45c3-a507-eed1ab960107 => generated 1265 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:48:42.897671 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-2b5ad253-fe0c-4968-8ea4-34b90f50334b tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:42.898309 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-2b5ad253-fe0c-4968-8ea4-34b90f50334b tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 6869ffb6-ce4f-4a91-b8d9-7765ea56e95a] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:42.905016 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-2b5ad253-fe0c-4968-8ea4-34b90f50334b tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:42.905503 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-2b5ad253-fe0c-4968-8ea4-34b90f50334b tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:42.905936 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-2b5ad253-fe0c-4968-8ea4-34b90f50334b tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:42.906630 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-2b5ad253-fe0c-4968-8ea4-34b90f50334b tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:42.907080 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-2b5ad253-fe0c-4968-8ea4-34b90f50334b tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:42.907501 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-2b5ad253-fe0c-4968-8ea4-34b90f50334b tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:42.969839 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG dbcounter [-] [127032] Writing DB stats nova_cell0:SELECT=2 {{(pid=127032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:48:43.054423 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-2b5ad253-fe0c-4968-8ea4-34b90f50334b tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:43.065445 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-2b5ad253-fe0c-4968-8ea4-34b90f50334b tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:43.067662 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-2b5ad253-fe0c-4968-8ea4-34b90f50334b tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:43.068934 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-2b5ad253-fe0c-4968-8ea4-34b90f50334b tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a" status: 200 len: 1720 microversion: 2.20 time: 0.175442 Oct 28 09:48:43.069534 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 187/368] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:48:42 2022] GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a => generated 1720 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:48:43.082407 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-9946928f-0ec9-46b9-bdbc-92eecf3d11c8 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:43.083538 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-9946928f-0ec9-46b9-bdbc-92eecf3d11c8 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] [instance: 91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:43.091265 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-9946928f-0ec9-46b9-bdbc-92eecf3d11c8 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:43.091714 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-9946928f-0ec9-46b9-bdbc-92eecf3d11c8 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:43.092212 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-9946928f-0ec9-46b9-bdbc-92eecf3d11c8 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:43.092911 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-9946928f-0ec9-46b9-bdbc-92eecf3d11c8 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:43.093538 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-9946928f-0ec9-46b9-bdbc-92eecf3d11c8 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:43.093964 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-9946928f-0ec9-46b9-bdbc-92eecf3d11c8 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:43.198888 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [req-11982315-18c4-4d1e-b284-3c2ec4e8d2e2 req-f3b9ca5f-db4e-4176-9135-b5ca12c5326a admin admin] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:43.202379 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-11982315-18c4-4d1e-b284-3c2ec4e8d2e2 req-f3b9ca5f-db4e-4176-9135-b5ca12c5326a admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:43.202872 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-11982315-18c4-4d1e-b284-3c2ec4e8d2e2 req-f3b9ca5f-db4e-4176-9135-b5ca12c5326a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:43.203310 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-11982315-18c4-4d1e-b284-3c2ec4e8d2e2 req-f3b9ca5f-db4e-4176-9135-b5ca12c5326a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:43.212050 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-11982315-18c4-4d1e-b284-3c2ec4e8d2e2 req-f3b9ca5f-db4e-4176-9135-b5ca12c5326a admin admin] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:43.212349 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-11982315-18c4-4d1e-b284-3c2ec4e8d2e2 req-f3b9ca5f-db4e-4176-9135-b5ca12c5326a admin admin] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:43.212955 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-11982315-18c4-4d1e-b284-3c2ec4e8d2e2 req-f3b9ca5f-db4e-4176-9135-b5ca12c5326a admin admin] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:43.229603 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [req-11982315-18c4-4d1e-b284-3c2ec4e8d2e2 req-f3b9ca5f-db4e-4176-9135-b5ca12c5326a admin admin] 10.222.0.58 "DELETE /compute/v2.1/os-assisted-volume-snapshots/f6b07f38-1ae6-44cd-9c93-ea1ee0cfa783?delete_info=%7B%22file_to_merge%22:%20%22volume-4adfb3fc-0236-45dc-a5b9-1e3c07a57b4b.f6b07f38-1ae6-44cd-9c93-ea1ee0cfa783.vhdx%22,%20%22volume_id%22:%20%224adfb3fc-0236-45dc-a5b9-1e3c07a57b4b%22%7D" status: 204 len: 0 microversion: 2.1 time: 0.087470 Oct 28 09:48:43.230242 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 188/369] 10.222.0.58 () {62 vars in 1800 bytes} [Fri Oct 28 09:48:43 2022] DELETE /compute/v2.1/os-assisted-volume-snapshots/f6b07f38-1ae6-44cd-9c93-ea1ee0cfa783?delete_info=%7B%22file_to_merge%22:%20%22volume-4adfb3fc-0236-45dc-a5b9-1e3c07a57b4b.f6b07f38-1ae6-44cd-9c93-ea1ee0cfa783.vhdx%22,%20%22volume_id%22:%20%224adfb3fc-0236-45dc-a5b9-1e3c07a57b4b%22%7D => generated 0 bytes in 89 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 09:48:43.242465 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-9946928f-0ec9-46b9-bdbc-92eecf3d11c8 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bee2d5f599642788c32e0d8b8338c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e7d531c0f4a33a869309af965e3e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:43.252387 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-9946928f-0ec9-46b9-bdbc-92eecf3d11c8 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] 10.222.0.52 "GET /compute/v2.1/servers/91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1" status: 200 len: 1722 microversion: 2.1 time: 0.173835 Oct 28 09:48:43.252965 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 182/370] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:48:43 2022] GET /compute/v2.1/servers/91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1 => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:48:43.304469 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-bd120cbf-f9e3-4c1b-b93d-b701ad7d1947 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:43.305381 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-bd120cbf-f9e3-4c1b-b93d-b701ad7d1947 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: e6ddb7f9-7854-4aa1-a174-2048b9a40431] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:43.312115 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-bd120cbf-f9e3-4c1b-b93d-b701ad7d1947 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:43.312601 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-bd120cbf-f9e3-4c1b-b93d-b701ad7d1947 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:43.313035 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-bd120cbf-f9e3-4c1b-b93d-b701ad7d1947 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:43.313724 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-bd120cbf-f9e3-4c1b-b93d-b701ad7d1947 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:43.314177 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-bd120cbf-f9e3-4c1b-b93d-b701ad7d1947 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:43.314600 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-bd120cbf-f9e3-4c1b-b93d-b701ad7d1947 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:43.396611 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-1ee244fe-4112-434e-a35d-75ef2fb2a023 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:43.397231 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-1ee244fe-4112-434e-a35d-75ef2fb2a023 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] [instance: 525c3586-feef-45c3-a507-eed1ab960107] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:43.404244 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-1ee244fe-4112-434e-a35d-75ef2fb2a023 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:43.404744 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-1ee244fe-4112-434e-a35d-75ef2fb2a023 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:43.405191 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-1ee244fe-4112-434e-a35d-75ef2fb2a023 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:43.405879 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-1ee244fe-4112-434e-a35d-75ef2fb2a023 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:43.406341 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-1ee244fe-4112-434e-a35d-75ef2fb2a023 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:43.406768 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-1ee244fe-4112-434e-a35d-75ef2fb2a023 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:43.461151 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-bd120cbf-f9e3-4c1b-b93d-b701ad7d1947 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe6eb38e8df492daaef5755ddea7773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234f69f21d7a456a9ab6a86c4ac2ede2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:43.470055 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-bd120cbf-f9e3-4c1b-b93d-b701ad7d1947 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] 10.222.0.52 "GET /compute/v2.1/servers/e6ddb7f9-7854-4aa1-a174-2048b9a40431" status: 200 len: 1371 microversion: 2.1 time: 0.169681 Oct 28 09:48:43.470706 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 189/371] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:48:43 2022] GET /compute/v2.1/servers/e6ddb7f9-7854-4aa1-a174-2048b9a40431 => generated 1371 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:48:43.479829 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-1ee244fe-4112-434e-a35d-75ef2fb2a023 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c1b55b5c04ba380ed8ffdaa462bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa6bd99403b4421acb8bd714c9450c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:43.489416 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-1ee244fe-4112-434e-a35d-75ef2fb2a023 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] 10.222.0.52 "GET /compute/v2.1/servers/525c3586-feef-45c3-a507-eed1ab960107" status: 200 len: 1283 microversion: 2.1 time: 0.096831 Oct 28 09:48:43.489998 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 183/372] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:48:43 2022] GET /compute/v2.1/servers/525c3586-feef-45c3-a507-eed1ab960107 => generated 1283 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:48:44.094675 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-0d012195-297f-4d9b-abf1-d33c4b0f0f86 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:44.095291 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-0d012195-297f-4d9b-abf1-d33c4b0f0f86 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 6869ffb6-ce4f-4a91-b8d9-7765ea56e95a] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:44.101995 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-0d012195-297f-4d9b-abf1-d33c4b0f0f86 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:44.102556 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-0d012195-297f-4d9b-abf1-d33c4b0f0f86 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:44.103003 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-0d012195-297f-4d9b-abf1-d33c4b0f0f86 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:44.103901 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-0d012195-297f-4d9b-abf1-d33c4b0f0f86 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:44.104529 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-0d012195-297f-4d9b-abf1-d33c4b0f0f86 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:44.104953 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-0d012195-297f-4d9b-abf1-d33c4b0f0f86 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:44.243880 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-0d012195-297f-4d9b-abf1-d33c4b0f0f86 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:44.252286 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-0d012195-297f-4d9b-abf1-d33c4b0f0f86 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:44.253793 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-0d012195-297f-4d9b-abf1-d33c4b0f0f86 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:44.254905 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-0d012195-297f-4d9b-abf1-d33c4b0f0f86 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a" status: 200 len: 1720 microversion: 2.20 time: 0.164411 Oct 28 09:48:44.255498 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 190/373] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:48:44 2022] GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a => generated 1720 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:48:44.276029 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-95e4b4da-389a-437a-af48-d644a7dc3bd8 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:44.276636 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-95e4b4da-389a-437a-af48-d644a7dc3bd8 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] [instance: 91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:44.285519 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-95e4b4da-389a-437a-af48-d644a7dc3bd8 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:44.286017 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-95e4b4da-389a-437a-af48-d644a7dc3bd8 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:44.286453 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-95e4b4da-389a-437a-af48-d644a7dc3bd8 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:44.287149 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-95e4b4da-389a-437a-af48-d644a7dc3bd8 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:44.287604 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-95e4b4da-389a-437a-af48-d644a7dc3bd8 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:44.288054 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-95e4b4da-389a-437a-af48-d644a7dc3bd8 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:44.418731 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-95e4b4da-389a-437a-af48-d644a7dc3bd8 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bee2d5f599642788c32e0d8b8338c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e7d531c0f4a33a869309af965e3e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:44.426921 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-95e4b4da-389a-437a-af48-d644a7dc3bd8 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] 10.222.0.52 "GET /compute/v2.1/servers/91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1" status: 200 len: 1722 microversion: 2.1 time: 0.154869 Oct 28 09:48:44.427575 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 184/374] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:48:44 2022] GET /compute/v2.1/servers/91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:48:44.494621 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-aff464f5-826a-4afe-bb9a-9683156f5e61 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:44.495235 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-aff464f5-826a-4afe-bb9a-9683156f5e61 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: e6ddb7f9-7854-4aa1-a174-2048b9a40431] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:44.501140 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-aff464f5-826a-4afe-bb9a-9683156f5e61 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:44.501623 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-aff464f5-826a-4afe-bb9a-9683156f5e61 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:44.502061 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-aff464f5-826a-4afe-bb9a-9683156f5e61 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:44.502754 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-aff464f5-826a-4afe-bb9a-9683156f5e61 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:44.503211 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-aff464f5-826a-4afe-bb9a-9683156f5e61 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:44.503638 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-aff464f5-826a-4afe-bb9a-9683156f5e61 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:44.512458 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-ed78a80c-ee74-43df-9d26-6051500d73c9 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:44.513133 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-ed78a80c-ee74-43df-9d26-6051500d73c9 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] [instance: 525c3586-feef-45c3-a507-eed1ab960107] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:44.519289 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-ed78a80c-ee74-43df-9d26-6051500d73c9 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:44.519911 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-ed78a80c-ee74-43df-9d26-6051500d73c9 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:44.520554 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-ed78a80c-ee74-43df-9d26-6051500d73c9 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:44.521355 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-ed78a80c-ee74-43df-9d26-6051500d73c9 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:44.521912 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-ed78a80c-ee74-43df-9d26-6051500d73c9 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:44.522401 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-ed78a80c-ee74-43df-9d26-6051500d73c9 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:44.616401 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-ed78a80c-ee74-43df-9d26-6051500d73c9 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c1b55b5c04ba380ed8ffdaa462bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa6bd99403b4421acb8bd714c9450c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:44.627575 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-ed78a80c-ee74-43df-9d26-6051500d73c9 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] 10.222.0.52 "GET /compute/v2.1/servers/525c3586-feef-45c3-a507-eed1ab960107" status: 200 len: 1283 microversion: 2.1 time: 0.118964 Oct 28 09:48:44.628335 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 185/375] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:48:44 2022] GET /compute/v2.1/servers/525c3586-feef-45c3-a507-eed1ab960107 => generated 1283 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:48:44.677215 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-aff464f5-826a-4afe-bb9a-9683156f5e61 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe6eb38e8df492daaef5755ddea7773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234f69f21d7a456a9ab6a86c4ac2ede2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:44.685550 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-aff464f5-826a-4afe-bb9a-9683156f5e61 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] 10.222.0.52 "GET /compute/v2.1/servers/e6ddb7f9-7854-4aa1-a174-2048b9a40431" status: 200 len: 1371 microversion: 2.1 time: 0.195329 Oct 28 09:48:44.686121 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 191/376] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:48:44 2022] GET /compute/v2.1/servers/e6ddb7f9-7854-4aa1-a174-2048b9a40431 => generated 1371 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:48:45.282030 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-b507b869-0b5c-466a-b6f8-91fd0c1c00f3 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:45.282660 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-b507b869-0b5c-466a-b6f8-91fd0c1c00f3 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 6869ffb6-ce4f-4a91-b8d9-7765ea56e95a] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:45.289101 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-b507b869-0b5c-466a-b6f8-91fd0c1c00f3 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:45.289588 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-b507b869-0b5c-466a-b6f8-91fd0c1c00f3 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:45.290526 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-b507b869-0b5c-466a-b6f8-91fd0c1c00f3 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:45.291227 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-b507b869-0b5c-466a-b6f8-91fd0c1c00f3 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:45.291679 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-b507b869-0b5c-466a-b6f8-91fd0c1c00f3 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:45.292778 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-b507b869-0b5c-466a-b6f8-91fd0c1c00f3 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:45.432873 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-b507b869-0b5c-466a-b6f8-91fd0c1c00f3 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:45.440816 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-b507b869-0b5c-466a-b6f8-91fd0c1c00f3 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:45.442250 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-b507b869-0b5c-466a-b6f8-91fd0c1c00f3 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:45.443409 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-b507b869-0b5c-466a-b6f8-91fd0c1c00f3 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a" status: 200 len: 1720 microversion: 2.20 time: 0.165847 Oct 28 09:48:45.444219 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 186/377] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:48:45 2022] GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a => generated 1720 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:48:45.450514 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-74298b28-fe5c-4733-8070-b7e62ed06eab tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:45.451244 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-74298b28-fe5c-4733-8070-b7e62ed06eab tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] [instance: 91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:45.456847 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG dbcounter [-] [127032] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:48:45.458978 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-74298b28-fe5c-4733-8070-b7e62ed06eab tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:45.459625 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-74298b28-fe5c-4733-8070-b7e62ed06eab tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:45.460316 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-74298b28-fe5c-4733-8070-b7e62ed06eab tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:45.461155 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-74298b28-fe5c-4733-8070-b7e62ed06eab tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:45.461741 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-74298b28-fe5c-4733-8070-b7e62ed06eab tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:45.462265 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-74298b28-fe5c-4733-8070-b7e62ed06eab tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:45.651226 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-ff4b230e-e864-4661-85f0-32f3cefea922 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:45.651937 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-ff4b230e-e864-4661-85f0-32f3cefea922 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] [instance: 525c3586-feef-45c3-a507-eed1ab960107] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:45.658298 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-ff4b230e-e864-4661-85f0-32f3cefea922 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:45.658934 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-ff4b230e-e864-4661-85f0-32f3cefea922 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:45.659459 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-ff4b230e-e864-4661-85f0-32f3cefea922 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:45.660293 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-ff4b230e-e864-4661-85f0-32f3cefea922 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:45.660981 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-ff4b230e-e864-4661-85f0-32f3cefea922 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:45.661628 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-ff4b230e-e864-4661-85f0-32f3cefea922 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:45.786713 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-ff4b230e-e864-4661-85f0-32f3cefea922 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c1b55b5c04ba380ed8ffdaa462bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa6bd99403b4421acb8bd714c9450c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:45.795715 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-ff4b230e-e864-4661-85f0-32f3cefea922 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] 10.222.0.52 "GET /compute/v2.1/servers/525c3586-feef-45c3-a507-eed1ab960107" status: 200 len: 1271 microversion: 2.1 time: 0.149004 Oct 28 09:48:45.796577 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 187/378] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:48:45 2022] GET /compute/v2.1/servers/525c3586-feef-45c3-a507-eed1ab960107 => generated 1271 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:48:45.811457 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-74298b28-fe5c-4733-8070-b7e62ed06eab tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bee2d5f599642788c32e0d8b8338c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e7d531c0f4a33a869309af965e3e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:45.817927 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-1f6a4456-3443-42a3-ab1a-6e15c26d224c tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:45.818554 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-1f6a4456-3443-42a3-ab1a-6e15c26d224c tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: e6ddb7f9-7854-4aa1-a174-2048b9a40431] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:45.819927 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-74298b28-fe5c-4733-8070-b7e62ed06eab tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] 10.222.0.52 "GET /compute/v2.1/servers/91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1" status: 200 len: 1722 microversion: 2.1 time: 0.373376 Oct 28 09:48:45.820504 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 192/379] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:48:45 2022] GET /compute/v2.1/servers/91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1 => generated 1722 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:48:45.824043 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG dbcounter [-] [127033] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=127033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:48:45.826232 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-1f6a4456-3443-42a3-ab1a-6e15c26d224c tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:45.826892 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-1f6a4456-3443-42a3-ab1a-6e15c26d224c tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:45.827331 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-1f6a4456-3443-42a3-ab1a-6e15c26d224c tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:45.828108 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-1f6a4456-3443-42a3-ab1a-6e15c26d224c tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:45.828509 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-1f6a4456-3443-42a3-ab1a-6e15c26d224c tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:45.828926 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-1f6a4456-3443-42a3-ab1a-6e15c26d224c tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:45.851775 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG dbcounter [-] [127033] Writing DB stats nova_cell1:SELECT=100 {{(pid=127033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:48:45.964355 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-1f6a4456-3443-42a3-ab1a-6e15c26d224c tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe6eb38e8df492daaef5755ddea7773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234f69f21d7a456a9ab6a86c4ac2ede2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:45.971874 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-1f6a4456-3443-42a3-ab1a-6e15c26d224c tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] 10.222.0.52 "GET /compute/v2.1/servers/e6ddb7f9-7854-4aa1-a174-2048b9a40431" status: 200 len: 1371 microversion: 2.1 time: 0.159369 Oct 28 09:48:45.972431 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 188/380] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:48:45 2022] GET /compute/v2.1/servers/e6ddb7f9-7854-4aa1-a174-2048b9a40431 => generated 1371 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:48:46.470021 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-fa2ed3ee-2c08-4bf6-b97c-890ac4c4ba35 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:46.470643 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-fa2ed3ee-2c08-4bf6-b97c-890ac4c4ba35 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 6869ffb6-ce4f-4a91-b8d9-7765ea56e95a] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:46.485282 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-fa2ed3ee-2c08-4bf6-b97c-890ac4c4ba35 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:46.485841 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-fa2ed3ee-2c08-4bf6-b97c-890ac4c4ba35 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:46.486275 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-fa2ed3ee-2c08-4bf6-b97c-890ac4c4ba35 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:46.487083 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-fa2ed3ee-2c08-4bf6-b97c-890ac4c4ba35 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:46.487535 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-fa2ed3ee-2c08-4bf6-b97c-890ac4c4ba35 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:46.487989 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-fa2ed3ee-2c08-4bf6-b97c-890ac4c4ba35 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:46.631867 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-fa2ed3ee-2c08-4bf6-b97c-890ac4c4ba35 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:46.641558 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-fa2ed3ee-2c08-4bf6-b97c-890ac4c4ba35 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:46.643009 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-fa2ed3ee-2c08-4bf6-b97c-890ac4c4ba35 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:46.644206 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-fa2ed3ee-2c08-4bf6-b97c-890ac4c4ba35 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a" status: 200 len: 1720 microversion: 2.20 time: 0.178787 Oct 28 09:48:46.645249 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 193/381] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:48:46 2022] GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a => generated 1720 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:48:46.825436 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-e0a5058d-16a8-4c56-9c5c-6f861cb51959 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:46.826229 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-e0a5058d-16a8-4c56-9c5c-6f861cb51959 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] [instance: 525c3586-feef-45c3-a507-eed1ab960107] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:46.833598 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-e0a5058d-16a8-4c56-9c5c-6f861cb51959 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:46.834182 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-e0a5058d-16a8-4c56-9c5c-6f861cb51959 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:46.834695 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-e0a5058d-16a8-4c56-9c5c-6f861cb51959 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:46.835468 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-e0a5058d-16a8-4c56-9c5c-6f861cb51959 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:46.836059 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-e0a5058d-16a8-4c56-9c5c-6f861cb51959 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:46.836778 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-e0a5058d-16a8-4c56-9c5c-6f861cb51959 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:46.847578 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-004e9fb0-a6e6-4d16-991e-01f3583c97e5 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:46.848482 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-004e9fb0-a6e6-4d16-991e-01f3583c97e5 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] [instance: 91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:46.856170 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-004e9fb0-a6e6-4d16-991e-01f3583c97e5 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:46.856665 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-004e9fb0-a6e6-4d16-991e-01f3583c97e5 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:46.857360 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-004e9fb0-a6e6-4d16-991e-01f3583c97e5 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:46.858296 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-004e9fb0-a6e6-4d16-991e-01f3583c97e5 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:46.858907 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-004e9fb0-a6e6-4d16-991e-01f3583c97e5 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:46.859489 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-004e9fb0-a6e6-4d16-991e-01f3583c97e5 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:47.110306 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-004e9fb0-a6e6-4d16-991e-01f3583c97e5 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bee2d5f599642788c32e0d8b8338c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e7d531c0f4a33a869309af965e3e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:47.123836 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-004e9fb0-a6e6-4d16-991e-01f3583c97e5 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] 10.222.0.52 "GET /compute/v2.1/servers/91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1" status: 200 len: 1722 microversion: 2.1 time: 0.281558 Oct 28 09:48:47.124837 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 194/382] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:48:46 2022] GET /compute/v2.1/servers/91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1 => generated 1722 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:48:47.132645 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-8cd9a34e-37f3-4e79-8774-9f19f921e3c3 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:47.133928 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-8cd9a34e-37f3-4e79-8774-9f19f921e3c3 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: e6ddb7f9-7854-4aa1-a174-2048b9a40431] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:47.145652 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-e0a5058d-16a8-4c56-9c5c-6f861cb51959 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c1b55b5c04ba380ed8ffdaa462bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa6bd99403b4421acb8bd714c9450c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:47.156518 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-e0a5058d-16a8-4c56-9c5c-6f861cb51959 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] 10.222.0.52 "GET /compute/v2.1/servers/525c3586-feef-45c3-a507-eed1ab960107" status: 200 len: 1313 microversion: 2.1 time: 0.335182 Oct 28 09:48:47.163420 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 189/383] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:48:46 2022] GET /compute/v2.1/servers/525c3586-feef-45c3-a507-eed1ab960107 => generated 1313 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:48:47.168237 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-8cd9a34e-37f3-4e79-8774-9f19f921e3c3 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:47.168993 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-8cd9a34e-37f3-4e79-8774-9f19f921e3c3 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:47.170223 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-8cd9a34e-37f3-4e79-8774-9f19f921e3c3 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:47.171239 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-8cd9a34e-37f3-4e79-8774-9f19f921e3c3 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:47.171697 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-8cd9a34e-37f3-4e79-8774-9f19f921e3c3 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:47.172216 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-8cd9a34e-37f3-4e79-8774-9f19f921e3c3 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:47.336746 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-8cd9a34e-37f3-4e79-8774-9f19f921e3c3 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe6eb38e8df492daaef5755ddea7773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234f69f21d7a456a9ab6a86c4ac2ede2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:47.344684 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-8cd9a34e-37f3-4e79-8774-9f19f921e3c3 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] 10.222.0.52 "GET /compute/v2.1/servers/e6ddb7f9-7854-4aa1-a174-2048b9a40431" status: 200 len: 1371 microversion: 2.1 time: 0.218245 Oct 28 09:48:47.345537 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 195/384] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:48:47 2022] GET /compute/v2.1/servers/e6ddb7f9-7854-4aa1-a174-2048b9a40431 => generated 1371 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:48:47.670956 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-9d5581d4-0b59-4f0f-a480-1bec94245592 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:47.671986 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-9d5581d4-0b59-4f0f-a480-1bec94245592 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 6869ffb6-ce4f-4a91-b8d9-7765ea56e95a] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:47.678038 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-9d5581d4-0b59-4f0f-a480-1bec94245592 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:47.678526 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-9d5581d4-0b59-4f0f-a480-1bec94245592 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:47.679138 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-9d5581d4-0b59-4f0f-a480-1bec94245592 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:47.679900 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-9d5581d4-0b59-4f0f-a480-1bec94245592 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:47.681098 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-9d5581d4-0b59-4f0f-a480-1bec94245592 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:47.681529 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-9d5581d4-0b59-4f0f-a480-1bec94245592 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:47.809628 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [req-732fb16e-8fd1-4fbe-a2df-2c95db5a15e4 req-7bac10b3-9df7-4a5c-aa08-5675e460802d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "525c3586-feef-45c3-a507-eed1ab960107", "tag": "6e1adc0b-821e-4f50-ba74-17de52b39a62"}]} {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:48:47.823068 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-732fb16e-8fd1-4fbe-a2df-2c95db5a15e4 req-7bac10b3-9df7-4a5c-aa08-5675e460802d service nova] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:47.823541 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-732fb16e-8fd1-4fbe-a2df-2c95db5a15e4 req-7bac10b3-9df7-4a5c-aa08-5675e460802d service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:47.824046 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-732fb16e-8fd1-4fbe-a2df-2c95db5a15e4 req-7bac10b3-9df7-4a5c-aa08-5675e460802d service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:47.839113 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-9d5581d4-0b59-4f0f-a480-1bec94245592 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:47.843596 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.compute.server_external_events [req-732fb16e-8fd1-4fbe-a2df-2c95db5a15e4 req-7bac10b3-9df7-4a5c-aa08-5675e460802d service nova] Creating event network-changed:6e1adc0b-821e-4f50-ba74-17de52b39a62 for instance 525c3586-feef-45c3-a507-eed1ab960107 on hv-cinder-zed-3 Oct 28 09:48:47.851576 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-9d5581d4-0b59-4f0f-a480-1bec94245592 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:47.853833 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-9d5581d4-0b59-4f0f-a480-1bec94245592 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:47.855033 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-9d5581d4-0b59-4f0f-a480-1bec94245592 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a" status: 200 len: 1741 microversion: 2.20 time: 0.188210 Oct 28 09:48:47.855699 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 190/385] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:48:47 2022] GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a => generated 1741 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:48:47.857783 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [req-732fb16e-8fd1-4fbe-a2df-2c95db5a15e4 req-7bac10b3-9df7-4a5c-aa08-5675e460802d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053488 Oct 28 09:48:47.858364 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 196/386] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Oct 28 09:48:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 09:48:48.150994 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-191d1f2a-8512-4865-8d02-357bded70aeb tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:48.151633 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-191d1f2a-8512-4865-8d02-357bded70aeb tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] [instance: 91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:48.157872 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-191d1f2a-8512-4865-8d02-357bded70aeb tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:48.158384 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-191d1f2a-8512-4865-8d02-357bded70aeb tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:48.158819 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-191d1f2a-8512-4865-8d02-357bded70aeb tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:48.159502 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-191d1f2a-8512-4865-8d02-357bded70aeb tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:48.159988 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-191d1f2a-8512-4865-8d02-357bded70aeb tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:48.160411 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-191d1f2a-8512-4865-8d02-357bded70aeb tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:48.191188 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-2fb416c0-c1f0-45cb-81c1-d797b6186770 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:48.191868 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-2fb416c0-c1f0-45cb-81c1-d797b6186770 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] [instance: 525c3586-feef-45c3-a507-eed1ab960107] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:48.198830 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-2fb416c0-c1f0-45cb-81c1-d797b6186770 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:48.199312 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-2fb416c0-c1f0-45cb-81c1-d797b6186770 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:48.199738 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-2fb416c0-c1f0-45cb-81c1-d797b6186770 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:48.200458 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-2fb416c0-c1f0-45cb-81c1-d797b6186770 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:48.200905 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-2fb416c0-c1f0-45cb-81c1-d797b6186770 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:48.201320 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-2fb416c0-c1f0-45cb-81c1-d797b6186770 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:48.361525 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-191d1f2a-8512-4865-8d02-357bded70aeb tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bee2d5f599642788c32e0d8b8338c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e7d531c0f4a33a869309af965e3e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:48.371462 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-191d1f2a-8512-4865-8d02-357bded70aeb tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] 10.222.0.52 "GET /compute/v2.1/servers/91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1" status: 200 len: 1699 microversion: 2.1 time: 0.224791 Oct 28 09:48:48.372086 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 191/387] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:48:48 2022] GET /compute/v2.1/servers/91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1 => generated 1699 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:48:48.383951 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-e53448e9-6e5b-4bbf-8f78-31f09adf509a tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:48.383951 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-e53448e9-6e5b-4bbf-8f78-31f09adf509a tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: e6ddb7f9-7854-4aa1-a174-2048b9a40431] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:48.385541 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-e53448e9-6e5b-4bbf-8f78-31f09adf509a tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:48.386039 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-e53448e9-6e5b-4bbf-8f78-31f09adf509a tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:48.386529 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-e53448e9-6e5b-4bbf-8f78-31f09adf509a tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:48.387227 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-e53448e9-6e5b-4bbf-8f78-31f09adf509a tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:48.387679 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-e53448e9-6e5b-4bbf-8f78-31f09adf509a tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:48.388136 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-e53448e9-6e5b-4bbf-8f78-31f09adf509a tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:48.402470 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-2fb416c0-c1f0-45cb-81c1-d797b6186770 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c1b55b5c04ba380ed8ffdaa462bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa6bd99403b4421acb8bd714c9450c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:48.410279 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-2fb416c0-c1f0-45cb-81c1-d797b6186770 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] 10.222.0.52 "GET /compute/v2.1/servers/525c3586-feef-45c3-a507-eed1ab960107" status: 200 len: 1313 microversion: 2.1 time: 0.223263 Oct 28 09:48:48.410932 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 197/388] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:48:48 2022] GET /compute/v2.1/servers/525c3586-feef-45c3-a507-eed1ab960107 => generated 1313 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:48:48.426156 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-e4f94ed5-288b-4b37-84b0-46ac46a657b5 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:48:48.433020 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-e4f94ed5-288b-4b37-84b0-46ac46a657b5 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:48.433592 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-e4f94ed5-288b-4b37-84b0-46ac46a657b5 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:48.434123 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-e4f94ed5-288b-4b37-84b0-46ac46a657b5 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:48.532592 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-e4f94ed5-288b-4b37-84b0-46ac46a657b5 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] [instance: 91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1] Going to try to start instance {{(pid=127032) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 28 09:48:48.537627 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-e53448e9-6e5b-4bbf-8f78-31f09adf509a tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe6eb38e8df492daaef5755ddea7773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234f69f21d7a456a9ab6a86c4ac2ede2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:48.545868 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-e53448e9-6e5b-4bbf-8f78-31f09adf509a tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] 10.222.0.52 "GET /compute/v2.1/servers/e6ddb7f9-7854-4aa1-a174-2048b9a40431" status: 200 len: 1371 microversion: 2.1 time: 0.172777 Oct 28 09:48:48.546440 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 192/389] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:48:48 2022] GET /compute/v2.1/servers/e6ddb7f9-7854-4aa1-a174-2048b9a40431 => generated 1371 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:48:48.578930 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-e4f94ed5-288b-4b37-84b0-46ac46a657b5 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] 10.222.0.52 "POST /compute/v2.1/servers/91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1/action" status: 202 len: 0 microversion: 2.1 time: 0.156229 Oct 28 09:48:48.579429 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 198/390] 10.222.0.52 () {60 vars in 1278 bytes} [Fri Oct 28 09:48:48 2022] POST /compute/v2.1/servers/91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1/action => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:48:48.588186 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-74946bb1-0607-458b-adc9-f4266f736a98 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:48.588800 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-74946bb1-0607-458b-adc9-f4266f736a98 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] [instance: 91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:48.594731 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-74946bb1-0607-458b-adc9-f4266f736a98 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:48.595250 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-74946bb1-0607-458b-adc9-f4266f736a98 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:48.595684 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-74946bb1-0607-458b-adc9-f4266f736a98 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:48.596411 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-74946bb1-0607-458b-adc9-f4266f736a98 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:48.597042 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-74946bb1-0607-458b-adc9-f4266f736a98 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:48.597471 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-74946bb1-0607-458b-adc9-f4266f736a98 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:48.691780 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [req-6c6a1f2c-a226-4a34-b6c5-16c006e213c2 req-ad4f3733-3841-495d-bf34-a91ef247015e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6ddb7f9-7854-4aa1-a174-2048b9a40431", "name": "network-vif-plugged", "status": "completed", "tag": "02ec0bd8-060a-466c-b33b-8ecb3e609c46"}]} {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:48:48.702386 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-6c6a1f2c-a226-4a34-b6c5-16c006e213c2 req-ad4f3733-3841-495d-bf34-a91ef247015e service nova] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:48.702762 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-6c6a1f2c-a226-4a34-b6c5-16c006e213c2 req-ad4f3733-3841-495d-bf34-a91ef247015e service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:48.703195 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-6c6a1f2c-a226-4a34-b6c5-16c006e213c2 req-ad4f3733-3841-495d-bf34-a91ef247015e service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:48.714925 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.compute.server_external_events [req-6c6a1f2c-a226-4a34-b6c5-16c006e213c2 req-ad4f3733-3841-495d-bf34-a91ef247015e service nova] Creating event network-vif-plugged:02ec0bd8-060a-466c-b33b-8ecb3e609c46 for instance e6ddb7f9-7854-4aa1-a174-2048b9a40431 on hv-cinder-zed-3 Oct 28 09:48:48.719734 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [req-6c6a1f2c-a226-4a34-b6c5-16c006e213c2 req-ad4f3733-3841-495d-bf34-a91ef247015e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032259 Oct 28 09:48:48.720365 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 199/391] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Oct 28 09:48:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 09:48:48.734929 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-74946bb1-0607-458b-adc9-f4266f736a98 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bee2d5f599642788c32e0d8b8338c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e7d531c0f4a33a869309af965e3e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:48.743627 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-74946bb1-0607-458b-adc9-f4266f736a98 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] 10.222.0.52 "GET /compute/v2.1/servers/91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1" status: 200 len: 1708 microversion: 2.1 time: 0.159326 Oct 28 09:48:48.744237 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 193/392] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:48:48 2022] GET /compute/v2.1/servers/91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1 => generated 1708 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:48:48.883048 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-25e35180-8da5-4ae3-b106-43403cd74039 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:48.883802 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-25e35180-8da5-4ae3-b106-43403cd74039 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 6869ffb6-ce4f-4a91-b8d9-7765ea56e95a] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:48.891014 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-25e35180-8da5-4ae3-b106-43403cd74039 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:48.891493 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-25e35180-8da5-4ae3-b106-43403cd74039 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:48.891958 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-25e35180-8da5-4ae3-b106-43403cd74039 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:48.892644 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-25e35180-8da5-4ae3-b106-43403cd74039 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:48.893087 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-25e35180-8da5-4ae3-b106-43403cd74039 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:48.893497 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-25e35180-8da5-4ae3-b106-43403cd74039 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:49.026628 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-25e35180-8da5-4ae3-b106-43403cd74039 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:49.030285 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG dbcounter [-] [127032] Writing DB stats nova_cell0:SELECT=8 {{(pid=127032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:48:49.036971 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-25e35180-8da5-4ae3-b106-43403cd74039 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:49.038421 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-25e35180-8da5-4ae3-b106-43403cd74039 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:49.039623 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-25e35180-8da5-4ae3-b106-43403cd74039 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a" status: 200 len: 1741 microversion: 2.20 time: 0.162019 Oct 28 09:48:49.040197 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 200/393] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:48:48 2022] GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a => generated 1741 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:48:49.434714 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-781fa3c5-a10e-4766-be06-cdf03daa9b99 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:49.435304 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-781fa3c5-a10e-4766-be06-cdf03daa9b99 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] [instance: 525c3586-feef-45c3-a507-eed1ab960107] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:49.437669 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG dbcounter [-] [127033] Writing DB stats nova_cell0:SELECT=8 {{(pid=127033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:48:49.438345 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG dbcounter [-] [127033] Writing DB stats nova_cell0:SELECT=12 {{(pid=127033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:48:49.444696 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-781fa3c5-a10e-4766-be06-cdf03daa9b99 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:49.445193 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-781fa3c5-a10e-4766-be06-cdf03daa9b99 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:49.445630 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-781fa3c5-a10e-4766-be06-cdf03daa9b99 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:49.446908 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-781fa3c5-a10e-4766-be06-cdf03daa9b99 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:49.447368 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-781fa3c5-a10e-4766-be06-cdf03daa9b99 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:49.447814 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-781fa3c5-a10e-4766-be06-cdf03daa9b99 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:49.572956 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-a89c5275-6ea8-417b-97d6-c80dab3019be tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:49.573902 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-a89c5275-6ea8-417b-97d6-c80dab3019be tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: e6ddb7f9-7854-4aa1-a174-2048b9a40431] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:49.582325 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-a89c5275-6ea8-417b-97d6-c80dab3019be tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:49.585902 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-781fa3c5-a10e-4766-be06-cdf03daa9b99 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c1b55b5c04ba380ed8ffdaa462bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa6bd99403b4421acb8bd714c9450c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:49.589866 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-a89c5275-6ea8-417b-97d6-c80dab3019be tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:49.592275 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-a89c5275-6ea8-417b-97d6-c80dab3019be tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:49.593000 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-a89c5275-6ea8-417b-97d6-c80dab3019be tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:49.593451 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-a89c5275-6ea8-417b-97d6-c80dab3019be tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:49.593869 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-a89c5275-6ea8-417b-97d6-c80dab3019be tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:49.598211 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-781fa3c5-a10e-4766-be06-cdf03daa9b99 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] 10.222.0.52 "GET /compute/v2.1/servers/525c3586-feef-45c3-a507-eed1ab960107" status: 200 len: 1313 microversion: 2.1 time: 0.167877 Oct 28 09:48:49.598797 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 194/394] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:48:49 2022] GET /compute/v2.1/servers/525c3586-feef-45c3-a507-eed1ab960107 => generated 1313 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:48:49.737740 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-a89c5275-6ea8-417b-97d6-c80dab3019be tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe6eb38e8df492daaef5755ddea7773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234f69f21d7a456a9ab6a86c4ac2ede2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:49.746723 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-a89c5275-6ea8-417b-97d6-c80dab3019be tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] 10.222.0.52 "GET /compute/v2.1/servers/e6ddb7f9-7854-4aa1-a174-2048b9a40431" status: 200 len: 1371 microversion: 2.1 time: 0.180933 Oct 28 09:48:49.747307 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 201/395] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:48:49 2022] GET /compute/v2.1/servers/e6ddb7f9-7854-4aa1-a174-2048b9a40431 => generated 1371 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:48:49.768511 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-42d81e98-d93e-483e-8fc7-c28e94c767d3 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:49.768724 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-42d81e98-d93e-483e-8fc7-c28e94c767d3 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] [instance: 91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:49.776152 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-42d81e98-d93e-483e-8fc7-c28e94c767d3 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:49.777136 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-42d81e98-d93e-483e-8fc7-c28e94c767d3 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:49.777578 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-42d81e98-d93e-483e-8fc7-c28e94c767d3 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:49.778276 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-42d81e98-d93e-483e-8fc7-c28e94c767d3 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:49.778725 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-42d81e98-d93e-483e-8fc7-c28e94c767d3 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:49.779146 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-42d81e98-d93e-483e-8fc7-c28e94c767d3 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:49.910082 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-42d81e98-d93e-483e-8fc7-c28e94c767d3 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bee2d5f599642788c32e0d8b8338c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e7d531c0f4a33a869309af965e3e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:49.918356 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-42d81e98-d93e-483e-8fc7-c28e94c767d3 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] 10.222.0.52 "GET /compute/v2.1/servers/91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1" status: 200 len: 1708 microversion: 2.1 time: 0.154997 Oct 28 09:48:49.918921 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 195/396] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:48:49 2022] GET /compute/v2.1/servers/91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1 => generated 1708 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:48:50.065639 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-e645dd38-85ff-4fe5-b86e-9e50acd329b3 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:50.066177 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-e645dd38-85ff-4fe5-b86e-9e50acd329b3 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 6869ffb6-ce4f-4a91-b8d9-7765ea56e95a] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:50.072839 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-e645dd38-85ff-4fe5-b86e-9e50acd329b3 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:50.073321 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-e645dd38-85ff-4fe5-b86e-9e50acd329b3 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:50.073751 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-e645dd38-85ff-4fe5-b86e-9e50acd329b3 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:50.074439 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-e645dd38-85ff-4fe5-b86e-9e50acd329b3 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:50.074889 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-e645dd38-85ff-4fe5-b86e-9e50acd329b3 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:50.075307 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-e645dd38-85ff-4fe5-b86e-9e50acd329b3 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:50.077904 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG dbcounter [-] [127032] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:48:50.209159 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-e645dd38-85ff-4fe5-b86e-9e50acd329b3 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:50.217243 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-e645dd38-85ff-4fe5-b86e-9e50acd329b3 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:50.218676 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-e645dd38-85ff-4fe5-b86e-9e50acd329b3 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:50.219858 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-e645dd38-85ff-4fe5-b86e-9e50acd329b3 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a" status: 200 len: 1741 microversion: 2.20 time: 0.158245 Oct 28 09:48:50.220416 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 202/397] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:48:50 2022] GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a => generated 1741 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:48:50.623392 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-90c64a34-9d12-401a-8280-113e11d671bc tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:50.624190 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-90c64a34-9d12-401a-8280-113e11d671bc tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] [instance: 525c3586-feef-45c3-a507-eed1ab960107] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:50.630626 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-90c64a34-9d12-401a-8280-113e11d671bc tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:50.631461 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-90c64a34-9d12-401a-8280-113e11d671bc tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:50.632174 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-90c64a34-9d12-401a-8280-113e11d671bc tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:50.633068 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-90c64a34-9d12-401a-8280-113e11d671bc tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:50.633872 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-90c64a34-9d12-401a-8280-113e11d671bc tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:50.634507 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-90c64a34-9d12-401a-8280-113e11d671bc tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:50.684266 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [req-38fca7ae-79b0-48da-8cf3-d86b73220a4b req-7c92f8d3-aa30-4241-8505-7bb63115ac81 admin admin] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:50.687693 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-38fca7ae-79b0-48da-8cf3-d86b73220a4b req-7c92f8d3-aa30-4241-8505-7bb63115ac81 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:50.688262 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-38fca7ae-79b0-48da-8cf3-d86b73220a4b req-7c92f8d3-aa30-4241-8505-7bb63115ac81 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:50.688755 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-38fca7ae-79b0-48da-8cf3-d86b73220a4b req-7c92f8d3-aa30-4241-8505-7bb63115ac81 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:50.696992 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-38fca7ae-79b0-48da-8cf3-d86b73220a4b req-7c92f8d3-aa30-4241-8505-7bb63115ac81 admin admin] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:50.697577 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-38fca7ae-79b0-48da-8cf3-d86b73220a4b req-7c92f8d3-aa30-4241-8505-7bb63115ac81 admin admin] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:50.698070 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-38fca7ae-79b0-48da-8cf3-d86b73220a4b req-7c92f8d3-aa30-4241-8505-7bb63115ac81 admin admin] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:50.712601 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [req-38fca7ae-79b0-48da-8cf3-d86b73220a4b req-7c92f8d3-aa30-4241-8505-7bb63115ac81 admin admin] 10.222.0.58 "DELETE /compute/v2.1/os-assisted-volume-snapshots/31925d82-2dd9-4516-b446-037362ae1cc8?delete_info=%7B%22file_to_merge%22:%20%22volume-4adfb3fc-0236-45dc-a5b9-1e3c07a57b4b.31925d82-2dd9-4516-b446-037362ae1cc8.vhdx%22,%20%22volume_id%22:%20%224adfb3fc-0236-45dc-a5b9-1e3c07a57b4b%22%7D" status: 204 len: 0 microversion: 2.1 time: 0.159716 Oct 28 09:48:50.713283 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 196/398] 10.222.0.58 () {62 vars in 1800 bytes} [Fri Oct 28 09:48:50 2022] DELETE /compute/v2.1/os-assisted-volume-snapshots/31925d82-2dd9-4516-b446-037362ae1cc8?delete_info=%7B%22file_to_merge%22:%20%22volume-4adfb3fc-0236-45dc-a5b9-1e3c07a57b4b.31925d82-2dd9-4516-b446-037362ae1cc8.vhdx%22,%20%22volume_id%22:%20%224adfb3fc-0236-45dc-a5b9-1e3c07a57b4b%22%7D => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 09:48:50.770866 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-51507e65-43a8-4bd4-9bc4-97e778c67e77 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:50.771092 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-51507e65-43a8-4bd4-9bc4-97e778c67e77 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: e6ddb7f9-7854-4aa1-a174-2048b9a40431] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:50.777980 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-51507e65-43a8-4bd4-9bc4-97e778c67e77 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:50.778546 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-51507e65-43a8-4bd4-9bc4-97e778c67e77 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:50.779049 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-51507e65-43a8-4bd4-9bc4-97e778c67e77 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:50.779827 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-51507e65-43a8-4bd4-9bc4-97e778c67e77 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:50.780734 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-51507e65-43a8-4bd4-9bc4-97e778c67e77 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:50.781232 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-51507e65-43a8-4bd4-9bc4-97e778c67e77 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:50.781933 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-90c64a34-9d12-401a-8280-113e11d671bc tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c1b55b5c04ba380ed8ffdaa462bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa6bd99403b4421acb8bd714c9450c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:50.790077 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-90c64a34-9d12-401a-8280-113e11d671bc tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] 10.222.0.52 "GET /compute/v2.1/servers/525c3586-feef-45c3-a507-eed1ab960107" status: 200 len: 1313 microversion: 2.1 time: 0.170482 Oct 28 09:48:50.790703 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 203/399] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:48:50 2022] GET /compute/v2.1/servers/525c3586-feef-45c3-a507-eed1ab960107 => generated 1313 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:48:50.914150 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-51507e65-43a8-4bd4-9bc4-97e778c67e77 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe6eb38e8df492daaef5755ddea7773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234f69f21d7a456a9ab6a86c4ac2ede2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:50.922134 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-51507e65-43a8-4bd4-9bc4-97e778c67e77 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] 10.222.0.52 "GET /compute/v2.1/servers/e6ddb7f9-7854-4aa1-a174-2048b9a40431" status: 200 len: 1371 microversion: 2.1 time: 0.155938 Oct 28 09:48:50.922701 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 197/400] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:48:50 2022] GET /compute/v2.1/servers/e6ddb7f9-7854-4aa1-a174-2048b9a40431 => generated 1371 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:48:50.941123 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-86810d51-a008-44f9-96a5-0fc5d1b80f0e tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:50.941802 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-86810d51-a008-44f9-96a5-0fc5d1b80f0e tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] [instance: 91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:50.948653 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-86810d51-a008-44f9-96a5-0fc5d1b80f0e tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:50.949228 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-86810d51-a008-44f9-96a5-0fc5d1b80f0e tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:50.949654 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-86810d51-a008-44f9-96a5-0fc5d1b80f0e tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:50.950350 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-86810d51-a008-44f9-96a5-0fc5d1b80f0e tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:50.950795 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-86810d51-a008-44f9-96a5-0fc5d1b80f0e tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:50.951208 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-86810d51-a008-44f9-96a5-0fc5d1b80f0e tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:51.083122 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-86810d51-a008-44f9-96a5-0fc5d1b80f0e tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bee2d5f599642788c32e0d8b8338c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e7d531c0f4a33a869309af965e3e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:51.091874 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-86810d51-a008-44f9-96a5-0fc5d1b80f0e tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] 10.222.0.52 "GET /compute/v2.1/servers/91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1" status: 200 len: 1708 microversion: 2.1 time: 0.154569 Oct 28 09:48:51.092479 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 204/401] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:48:50 2022] GET /compute/v2.1/servers/91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1 => generated 1708 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:48:51.248576 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-d451ab9f-b5f3-4d16-97f7-df0839712d94 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:51.250339 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-d451ab9f-b5f3-4d16-97f7-df0839712d94 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 6869ffb6-ce4f-4a91-b8d9-7765ea56e95a] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:51.259097 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-d451ab9f-b5f3-4d16-97f7-df0839712d94 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:51.259973 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-d451ab9f-b5f3-4d16-97f7-df0839712d94 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:51.260625 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-d451ab9f-b5f3-4d16-97f7-df0839712d94 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:51.261527 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-d451ab9f-b5f3-4d16-97f7-df0839712d94 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:51.262176 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-d451ab9f-b5f3-4d16-97f7-df0839712d94 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:51.262790 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-d451ab9f-b5f3-4d16-97f7-df0839712d94 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:51.411399 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-d451ab9f-b5f3-4d16-97f7-df0839712d94 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:51.419980 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-d451ab9f-b5f3-4d16-97f7-df0839712d94 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:51.421765 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-d451ab9f-b5f3-4d16-97f7-df0839712d94 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:51.423094 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-d451ab9f-b5f3-4d16-97f7-df0839712d94 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a" status: 200 len: 1741 microversion: 2.20 time: 0.181369 Oct 28 09:48:51.424227 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 198/402] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:48:51 2022] GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a => generated 1741 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:48:51.813063 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-ca83abe9-e698-4706-938a-d4ea1544422f tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:51.813661 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-ca83abe9-e698-4706-938a-d4ea1544422f tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] [instance: 525c3586-feef-45c3-a507-eed1ab960107] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:51.819482 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ca83abe9-e698-4706-938a-d4ea1544422f tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:51.819991 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ca83abe9-e698-4706-938a-d4ea1544422f tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:51.820416 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ca83abe9-e698-4706-938a-d4ea1544422f tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:51.821770 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ca83abe9-e698-4706-938a-d4ea1544422f tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:51.822230 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ca83abe9-e698-4706-938a-d4ea1544422f tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:51.822629 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ca83abe9-e698-4706-938a-d4ea1544422f tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:51.945576 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-7bd5b5be-9fe1-4b58-b145-9028bd7e329f tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:51.946182 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-7bd5b5be-9fe1-4b58-b145-9028bd7e329f tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: e6ddb7f9-7854-4aa1-a174-2048b9a40431] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:51.952518 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-7bd5b5be-9fe1-4b58-b145-9028bd7e329f tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:51.952991 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-7bd5b5be-9fe1-4b58-b145-9028bd7e329f tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:51.953421 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-7bd5b5be-9fe1-4b58-b145-9028bd7e329f tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:51.954101 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-7bd5b5be-9fe1-4b58-b145-9028bd7e329f tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:51.954552 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-7bd5b5be-9fe1-4b58-b145-9028bd7e329f tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:51.954967 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-7bd5b5be-9fe1-4b58-b145-9028bd7e329f tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:51.959493 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-ca83abe9-e698-4706-938a-d4ea1544422f tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c1b55b5c04ba380ed8ffdaa462bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa6bd99403b4421acb8bd714c9450c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:51.968362 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-ca83abe9-e698-4706-938a-d4ea1544422f tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] 10.222.0.52 "GET /compute/v2.1/servers/525c3586-feef-45c3-a507-eed1ab960107" status: 200 len: 1313 microversion: 2.1 time: 0.159307 Oct 28 09:48:51.969184 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 205/403] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:48:51 2022] GET /compute/v2.1/servers/525c3586-feef-45c3-a507-eed1ab960107 => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:48:52.087167 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-7bd5b5be-9fe1-4b58-b145-9028bd7e329f tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe6eb38e8df492daaef5755ddea7773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234f69f21d7a456a9ab6a86c4ac2ede2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:52.095190 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-7bd5b5be-9fe1-4b58-b145-9028bd7e329f tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] 10.222.0.52 "GET /compute/v2.1/servers/e6ddb7f9-7854-4aa1-a174-2048b9a40431" status: 200 len: 1371 microversion: 2.1 time: 0.153538 Oct 28 09:48:52.095776 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 199/404] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:48:51 2022] GET /compute/v2.1/servers/e6ddb7f9-7854-4aa1-a174-2048b9a40431 => generated 1371 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:48:52.114853 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-5fd1d50b-6731-44cc-953b-87228fe3672e tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:52.115454 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-5fd1d50b-6731-44cc-953b-87228fe3672e tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] [instance: 91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:52.121810 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-5fd1d50b-6731-44cc-953b-87228fe3672e tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:52.122282 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-5fd1d50b-6731-44cc-953b-87228fe3672e tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:52.122707 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-5fd1d50b-6731-44cc-953b-87228fe3672e tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:52.123492 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-5fd1d50b-6731-44cc-953b-87228fe3672e tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:52.124010 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-5fd1d50b-6731-44cc-953b-87228fe3672e tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:52.124427 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-5fd1d50b-6731-44cc-953b-87228fe3672e tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:52.268564 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-5fd1d50b-6731-44cc-953b-87228fe3672e tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bee2d5f599642788c32e0d8b8338c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e7d531c0f4a33a869309af965e3e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:52.278058 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-5fd1d50b-6731-44cc-953b-87228fe3672e tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] 10.222.0.52 "GET /compute/v2.1/servers/91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1" status: 200 len: 1708 microversion: 2.1 time: 0.166899 Oct 28 09:48:52.278637 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 206/405] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:48:52 2022] GET /compute/v2.1/servers/91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1 => generated 1708 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:48:52.450576 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-1a14de50-231f-4152-bc33-3ce5c47c4c34 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:52.451586 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-1a14de50-231f-4152-bc33-3ce5c47c4c34 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 6869ffb6-ce4f-4a91-b8d9-7765ea56e95a] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:52.463363 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-1a14de50-231f-4152-bc33-3ce5c47c4c34 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:52.463909 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-1a14de50-231f-4152-bc33-3ce5c47c4c34 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:52.465568 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-1a14de50-231f-4152-bc33-3ce5c47c4c34 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:52.466339 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-1a14de50-231f-4152-bc33-3ce5c47c4c34 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:52.466826 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-1a14de50-231f-4152-bc33-3ce5c47c4c34 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:52.467261 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-1a14de50-231f-4152-bc33-3ce5c47c4c34 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:52.612540 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-1a14de50-231f-4152-bc33-3ce5c47c4c34 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:52.622157 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-1a14de50-231f-4152-bc33-3ce5c47c4c34 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:52.623618 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-1a14de50-231f-4152-bc33-3ce5c47c4c34 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:52.624903 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-1a14de50-231f-4152-bc33-3ce5c47c4c34 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a" status: 200 len: 1741 microversion: 2.20 time: 0.180809 Oct 28 09:48:52.625466 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 200/406] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:48:52 2022] GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a => generated 1741 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:48:52.671618 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [req-b4d5991e-081f-44e3-bbfd-43809184ad84 req-f93c915b-4a83-4abb-a9d1-24115d3f6dd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6869ffb6-ce4f-4a91-b8d9-7765ea56e95a", "name": "network-vif-plugged", "status": "completed", "tag": "f350d1f8-ff54-4a77-b413-0023d0d49856"}]} {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:48:52.682425 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-b4d5991e-081f-44e3-bbfd-43809184ad84 req-f93c915b-4a83-4abb-a9d1-24115d3f6dd6 service nova] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:52.683139 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-b4d5991e-081f-44e3-bbfd-43809184ad84 req-f93c915b-4a83-4abb-a9d1-24115d3f6dd6 service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:52.683654 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-b4d5991e-081f-44e3-bbfd-43809184ad84 req-f93c915b-4a83-4abb-a9d1-24115d3f6dd6 service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:52.695645 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.compute.server_external_events [req-b4d5991e-081f-44e3-bbfd-43809184ad84 req-f93c915b-4a83-4abb-a9d1-24115d3f6dd6 service nova] Creating event network-vif-plugged:f350d1f8-ff54-4a77-b413-0023d0d49856 for instance 6869ffb6-ce4f-4a91-b8d9-7765ea56e95a on hv-cinder-zed-3 Oct 28 09:48:52.702236 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [req-b4d5991e-081f-44e3-bbfd-43809184ad84 req-f93c915b-4a83-4abb-a9d1-24115d3f6dd6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034403 Oct 28 09:48:52.703186 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 207/407] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Oct 28 09:48:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:48:52.992069 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-72ea7654-3f92-4691-a756-612a5537487e tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:52.993392 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-72ea7654-3f92-4691-a756-612a5537487e tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] [instance: 525c3586-feef-45c3-a507-eed1ab960107] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:53.000160 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-72ea7654-3f92-4691-a756-612a5537487e tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:53.000668 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-72ea7654-3f92-4691-a756-612a5537487e tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:53.001140 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-72ea7654-3f92-4691-a756-612a5537487e tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:53.001837 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-72ea7654-3f92-4691-a756-612a5537487e tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:53.002296 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-72ea7654-3f92-4691-a756-612a5537487e tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:53.002720 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-72ea7654-3f92-4691-a756-612a5537487e tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:53.120619 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-1826a63e-b63e-4643-866d-7e8f5fa7813d tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:53.121745 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-1826a63e-b63e-4643-866d-7e8f5fa7813d tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: e6ddb7f9-7854-4aa1-a174-2048b9a40431] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:53.129388 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-1826a63e-b63e-4643-866d-7e8f5fa7813d tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:53.130612 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-1826a63e-b63e-4643-866d-7e8f5fa7813d tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:53.131389 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-1826a63e-b63e-4643-866d-7e8f5fa7813d tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:53.132374 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-1826a63e-b63e-4643-866d-7e8f5fa7813d tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:53.132985 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-1826a63e-b63e-4643-866d-7e8f5fa7813d tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:53.133978 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-1826a63e-b63e-4643-866d-7e8f5fa7813d tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:53.176267 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-72ea7654-3f92-4691-a756-612a5537487e tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c1b55b5c04ba380ed8ffdaa462bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa6bd99403b4421acb8bd714c9450c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:53.184895 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-72ea7654-3f92-4691-a756-612a5537487e tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] 10.222.0.52 "GET /compute/v2.1/servers/525c3586-feef-45c3-a507-eed1ab960107" status: 200 len: 1313 microversion: 2.1 time: 0.196724 Oct 28 09:48:53.185688 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 201/408] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:48:52 2022] GET /compute/v2.1/servers/525c3586-feef-45c3-a507-eed1ab960107 => generated 1313 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:48:53.207567 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG dbcounter [-] [127032] Writing DB stats nova_cell0:SELECT=2 {{(pid=127032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:48:53.285130 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-1826a63e-b63e-4643-866d-7e8f5fa7813d tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe6eb38e8df492daaef5755ddea7773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234f69f21d7a456a9ab6a86c4ac2ede2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:53.293588 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-1826a63e-b63e-4643-866d-7e8f5fa7813d tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] 10.222.0.52 "GET /compute/v2.1/servers/e6ddb7f9-7854-4aa1-a174-2048b9a40431" status: 200 len: 1565 microversion: 2.1 time: 0.177803 Oct 28 09:48:53.294229 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 208/409] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:48:53 2022] GET /compute/v2.1/servers/e6ddb7f9-7854-4aa1-a174-2048b9a40431 => generated 1565 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:48:53.304113 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-86d8f6c5-bc7a-4280-969f-b749523a94a9 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:53.304862 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-86d8f6c5-bc7a-4280-969f-b749523a94a9 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] [instance: 91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:53.311151 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-86d8f6c5-bc7a-4280-969f-b749523a94a9 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:53.311635 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-86d8f6c5-bc7a-4280-969f-b749523a94a9 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:53.312116 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-86d8f6c5-bc7a-4280-969f-b749523a94a9 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:53.312806 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-86d8f6c5-bc7a-4280-969f-b749523a94a9 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:53.313286 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-86d8f6c5-bc7a-4280-969f-b749523a94a9 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:53.313703 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-86d8f6c5-bc7a-4280-969f-b749523a94a9 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:53.322478 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-7dbef384-2512-4c27-9553-7de99083c1a6 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:53.323217 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-7dbef384-2512-4c27-9553-7de99083c1a6 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: e6ddb7f9-7854-4aa1-a174-2048b9a40431] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:53.329696 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-7dbef384-2512-4c27-9553-7de99083c1a6 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:53.330349 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-7dbef384-2512-4c27-9553-7de99083c1a6 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:53.330932 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-7dbef384-2512-4c27-9553-7de99083c1a6 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:53.331840 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-7dbef384-2512-4c27-9553-7de99083c1a6 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:53.332439 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-7dbef384-2512-4c27-9553-7de99083c1a6 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:53.333010 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-7dbef384-2512-4c27-9553-7de99083c1a6 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:53.443411 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-7dbef384-2512-4c27-9553-7de99083c1a6 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] 10.222.0.52 "GET /compute/v2.1/servers/e6ddb7f9-7854-4aa1-a174-2048b9a40431/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.124503 Oct 28 09:48:53.444687 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 209/410] 10.222.0.52 () {58 vars in 1275 bytes} [Fri Oct 28 09:48:53 2022] GET /compute/v2.1/servers/e6ddb7f9-7854-4aa1-a174-2048b9a40431/os-interface => generated 284 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:48:53.627963 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-86d8f6c5-bc7a-4280-969f-b749523a94a9 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bee2d5f599642788c32e0d8b8338c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e7d531c0f4a33a869309af965e3e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:53.637294 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-86d8f6c5-bc7a-4280-969f-b749523a94a9 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] 10.222.0.52 "GET /compute/v2.1/servers/91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1" status: 200 len: 1708 microversion: 2.1 time: 0.336987 Oct 28 09:48:53.638203 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 202/411] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:48:53 2022] GET /compute/v2.1/servers/91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1 => generated 1708 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:48:53.655705 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-79376e26-06ad-40c1-ba5a-cee92ae70273 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:53.656425 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-79376e26-06ad-40c1-ba5a-cee92ae70273 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 6869ffb6-ce4f-4a91-b8d9-7765ea56e95a] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:53.662914 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-79376e26-06ad-40c1-ba5a-cee92ae70273 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:53.663399 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-79376e26-06ad-40c1-ba5a-cee92ae70273 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:53.663865 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-79376e26-06ad-40c1-ba5a-cee92ae70273 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:53.666261 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-79376e26-06ad-40c1-ba5a-cee92ae70273 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:53.666727 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-79376e26-06ad-40c1-ba5a-cee92ae70273 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:53.667146 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-79376e26-06ad-40c1-ba5a-cee92ae70273 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:53.938140 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-79376e26-06ad-40c1-ba5a-cee92ae70273 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:53.946866 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-79376e26-06ad-40c1-ba5a-cee92ae70273 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:53.948365 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-79376e26-06ad-40c1-ba5a-cee92ae70273 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:53.949527 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-79376e26-06ad-40c1-ba5a-cee92ae70273 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a" status: 200 len: 1741 microversion: 2.20 time: 0.297704 Oct 28 09:48:53.950093 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 210/412] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:48:53 2022] GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a => generated 1741 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:48:54.208125 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-58bd646a-ad65-45d9-89b5-1b492e352445 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:54.208737 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-58bd646a-ad65-45d9-89b5-1b492e352445 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] [instance: 525c3586-feef-45c3-a507-eed1ab960107] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:54.215182 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-58bd646a-ad65-45d9-89b5-1b492e352445 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:54.215680 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-58bd646a-ad65-45d9-89b5-1b492e352445 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:54.216149 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-58bd646a-ad65-45d9-89b5-1b492e352445 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:54.216840 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-58bd646a-ad65-45d9-89b5-1b492e352445 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:54.217297 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-58bd646a-ad65-45d9-89b5-1b492e352445 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:54.217724 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-58bd646a-ad65-45d9-89b5-1b492e352445 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:54.435159 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-58bd646a-ad65-45d9-89b5-1b492e352445 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c1b55b5c04ba380ed8ffdaa462bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa6bd99403b4421acb8bd714c9450c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:54.442822 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-58bd646a-ad65-45d9-89b5-1b492e352445 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] 10.222.0.52 "GET /compute/v2.1/servers/525c3586-feef-45c3-a507-eed1ab960107" status: 200 len: 1313 microversion: 2.1 time: 0.238528 Oct 28 09:48:54.443480 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 203/413] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:48:54 2022] GET /compute/v2.1/servers/525c3586-feef-45c3-a507-eed1ab960107 => generated 1313 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:48:54.605732 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [req-5f796773-2bb6-447e-a7b5-fa08b250a1b6 req-7e41fa9b-ff29-4aa7-9dc4-d607b56d01da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6ddb7f9-7854-4aa1-a174-2048b9a40431", "tag": "02ec0bd8-060a-466c-b33b-8ecb3e609c46"}]} {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:48:54.616227 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-5f796773-2bb6-447e-a7b5-fa08b250a1b6 req-7e41fa9b-ff29-4aa7-9dc4-d607b56d01da service nova] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:54.616744 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-5f796773-2bb6-447e-a7b5-fa08b250a1b6 req-7e41fa9b-ff29-4aa7-9dc4-d607b56d01da service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:54.617302 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-5f796773-2bb6-447e-a7b5-fa08b250a1b6 req-7e41fa9b-ff29-4aa7-9dc4-d607b56d01da service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:54.629522 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.compute.server_external_events [req-5f796773-2bb6-447e-a7b5-fa08b250a1b6 req-7e41fa9b-ff29-4aa7-9dc4-d607b56d01da service nova] Creating event network-changed:02ec0bd8-060a-466c-b33b-8ecb3e609c46 for instance e6ddb7f9-7854-4aa1-a174-2048b9a40431 on hv-cinder-zed-3 Oct 28 09:48:54.635252 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [req-5f796773-2bb6-447e-a7b5-fa08b250a1b6 req-7e41fa9b-ff29-4aa7-9dc4-d607b56d01da service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033861 Oct 28 09:48:54.635896 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 211/414] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Oct 28 09:48:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:48:54.663939 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-0f10c09d-1560-4353-b789-4c1344841c42 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:54.664621 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-0f10c09d-1560-4353-b789-4c1344841c42 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] [instance: 91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:54.670408 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-0f10c09d-1560-4353-b789-4c1344841c42 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:54.670888 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-0f10c09d-1560-4353-b789-4c1344841c42 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:54.671315 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-0f10c09d-1560-4353-b789-4c1344841c42 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:54.672031 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-0f10c09d-1560-4353-b789-4c1344841c42 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:54.672487 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-0f10c09d-1560-4353-b789-4c1344841c42 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:54.672908 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-0f10c09d-1560-4353-b789-4c1344841c42 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:54.803631 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-0f10c09d-1560-4353-b789-4c1344841c42 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bee2d5f599642788c32e0d8b8338c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e7d531c0f4a33a869309af965e3e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:54.812596 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-0f10c09d-1560-4353-b789-4c1344841c42 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] 10.222.0.52 "GET /compute/v2.1/servers/91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1" status: 200 len: 1708 microversion: 2.1 time: 0.152587 Oct 28 09:48:54.813170 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 204/415] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:48:54 2022] GET /compute/v2.1/servers/91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1 => generated 1708 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:48:54.975194 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-8f160560-27e7-4d67-9d43-728ae3fe6fdf tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:54.975983 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-8f160560-27e7-4d67-9d43-728ae3fe6fdf tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 6869ffb6-ce4f-4a91-b8d9-7765ea56e95a] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:54.983170 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-8f160560-27e7-4d67-9d43-728ae3fe6fdf tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:54.983647 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-8f160560-27e7-4d67-9d43-728ae3fe6fdf tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:54.984099 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-8f160560-27e7-4d67-9d43-728ae3fe6fdf tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:54.984786 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-8f160560-27e7-4d67-9d43-728ae3fe6fdf tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:54.985232 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-8f160560-27e7-4d67-9d43-728ae3fe6fdf tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:54.985649 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-8f160560-27e7-4d67-9d43-728ae3fe6fdf tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:55.116820 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-8f160560-27e7-4d67-9d43-728ae3fe6fdf tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:55.125059 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-8f160560-27e7-4d67-9d43-728ae3fe6fdf tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:55.126503 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-8f160560-27e7-4d67-9d43-728ae3fe6fdf tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:55.127641 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-8f160560-27e7-4d67-9d43-728ae3fe6fdf tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a" status: 200 len: 1741 microversion: 2.20 time: 0.156887 Oct 28 09:48:55.128226 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 212/416] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:48:54 2022] GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a => generated 1741 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:48:55.467057 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-12cfcecd-07c9-4202-8892-4f3d2fdc37f7 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:55.467660 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-12cfcecd-07c9-4202-8892-4f3d2fdc37f7 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] [instance: 525c3586-feef-45c3-a507-eed1ab960107] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:55.474417 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-12cfcecd-07c9-4202-8892-4f3d2fdc37f7 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:55.474899 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-12cfcecd-07c9-4202-8892-4f3d2fdc37f7 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:55.475359 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-12cfcecd-07c9-4202-8892-4f3d2fdc37f7 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:55.476075 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-12cfcecd-07c9-4202-8892-4f3d2fdc37f7 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:55.476521 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-12cfcecd-07c9-4202-8892-4f3d2fdc37f7 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:55.476959 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-12cfcecd-07c9-4202-8892-4f3d2fdc37f7 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:55.616313 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-12cfcecd-07c9-4202-8892-4f3d2fdc37f7 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c1b55b5c04ba380ed8ffdaa462bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa6bd99403b4421acb8bd714c9450c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:55.620620 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG dbcounter [-] [127033] Writing DB stats nova_cell1:SELECT=100 {{(pid=127033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:48:55.625877 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-12cfcecd-07c9-4202-8892-4f3d2fdc37f7 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] 10.222.0.52 "GET /compute/v2.1/servers/525c3586-feef-45c3-a507-eed1ab960107" status: 200 len: 1313 microversion: 2.1 time: 0.162870 Oct 28 09:48:55.626458 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 205/417] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:48:55 2022] GET /compute/v2.1/servers/525c3586-feef-45c3-a507-eed1ab960107 => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:48:55.836520 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-9d0617b7-dffe-4cb2-b684-16915eed6648 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:55.837637 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-9d0617b7-dffe-4cb2-b684-16915eed6648 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] [instance: 91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:55.844071 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-9d0617b7-dffe-4cb2-b684-16915eed6648 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:55.844552 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-9d0617b7-dffe-4cb2-b684-16915eed6648 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:55.844982 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-9d0617b7-dffe-4cb2-b684-16915eed6648 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:55.845668 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-9d0617b7-dffe-4cb2-b684-16915eed6648 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:55.846122 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-9d0617b7-dffe-4cb2-b684-16915eed6648 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:55.846544 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-9d0617b7-dffe-4cb2-b684-16915eed6648 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:55.977213 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-9d0617b7-dffe-4cb2-b684-16915eed6648 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bee2d5f599642788c32e0d8b8338c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e7d531c0f4a33a869309af965e3e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:55.985679 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-9d0617b7-dffe-4cb2-b684-16915eed6648 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] 10.222.0.52 "GET /compute/v2.1/servers/91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1" status: 200 len: 1708 microversion: 2.1 time: 0.153127 Oct 28 09:48:55.986248 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 213/418] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:48:55 2022] GET /compute/v2.1/servers/91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1 => generated 1708 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:48:56.154472 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-8c921849-5713-4ed4-a2e1-3990d59a9113 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:56.155076 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-8c921849-5713-4ed4-a2e1-3990d59a9113 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 6869ffb6-ce4f-4a91-b8d9-7765ea56e95a] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:56.161209 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-8c921849-5713-4ed4-a2e1-3990d59a9113 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:56.161686 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-8c921849-5713-4ed4-a2e1-3990d59a9113 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:56.162119 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-8c921849-5713-4ed4-a2e1-3990d59a9113 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:56.162803 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-8c921849-5713-4ed4-a2e1-3990d59a9113 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:56.163256 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-8c921849-5713-4ed4-a2e1-3990d59a9113 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:56.163677 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-8c921849-5713-4ed4-a2e1-3990d59a9113 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:56.289420 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-8c921849-5713-4ed4-a2e1-3990d59a9113 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:56.297429 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-8c921849-5713-4ed4-a2e1-3990d59a9113 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:56.298860 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-8c921849-5713-4ed4-a2e1-3990d59a9113 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:56.300019 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-8c921849-5713-4ed4-a2e1-3990d59a9113 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a" status: 200 len: 1741 microversion: 2.20 time: 0.149476 Oct 28 09:48:56.300576 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 206/419] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:48:56 2022] GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a => generated 1741 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:48:56.650285 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-d509664d-bcfa-445c-8a34-c2aafc3fc09d tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:56.650924 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-d509664d-bcfa-445c-8a34-c2aafc3fc09d tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] [instance: 525c3586-feef-45c3-a507-eed1ab960107] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:56.656810 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-d509664d-bcfa-445c-8a34-c2aafc3fc09d tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:56.657396 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-d509664d-bcfa-445c-8a34-c2aafc3fc09d tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:56.657743 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-d509664d-bcfa-445c-8a34-c2aafc3fc09d tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:56.658428 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-d509664d-bcfa-445c-8a34-c2aafc3fc09d tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:56.658878 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-d509664d-bcfa-445c-8a34-c2aafc3fc09d tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:56.659474 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-d509664d-bcfa-445c-8a34-c2aafc3fc09d tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:56.793630 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-d509664d-bcfa-445c-8a34-c2aafc3fc09d tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c1b55b5c04ba380ed8ffdaa462bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa6bd99403b4421acb8bd714c9450c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:56.801237 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-d509664d-bcfa-445c-8a34-c2aafc3fc09d tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] 10.222.0.52 "GET /compute/v2.1/servers/525c3586-feef-45c3-a507-eed1ab960107" status: 200 len: 1313 microversion: 2.1 time: 0.155487 Oct 28 09:48:56.801812 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 214/420] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:48:56 2022] GET /compute/v2.1/servers/525c3586-feef-45c3-a507-eed1ab960107 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:48:57.009905 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-60ad5498-7069-4e5c-8692-d223edee253f tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:57.010433 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-60ad5498-7069-4e5c-8692-d223edee253f tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] [instance: 91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:57.016820 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-60ad5498-7069-4e5c-8692-d223edee253f tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:57.017305 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-60ad5498-7069-4e5c-8692-d223edee253f tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:57.017760 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-60ad5498-7069-4e5c-8692-d223edee253f tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:57.018473 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-60ad5498-7069-4e5c-8692-d223edee253f tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:57.018926 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-60ad5498-7069-4e5c-8692-d223edee253f tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:57.019345 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-60ad5498-7069-4e5c-8692-d223edee253f tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:57.158645 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-60ad5498-7069-4e5c-8692-d223edee253f tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bee2d5f599642788c32e0d8b8338c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e7d531c0f4a33a869309af965e3e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:57.167248 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-60ad5498-7069-4e5c-8692-d223edee253f tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] 10.222.0.52 "GET /compute/v2.1/servers/91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1" status: 200 len: 1712 microversion: 2.1 time: 0.161831 Oct 28 09:48:57.167833 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 207/421] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:48:57 2022] GET /compute/v2.1/servers/91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1 => generated 1712 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:48:57.326474 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-8eedb9bb-fe0d-43e6-a15d-f1c9b28a86d7 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:57.327013 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-8eedb9bb-fe0d-43e6-a15d-f1c9b28a86d7 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 6869ffb6-ce4f-4a91-b8d9-7765ea56e95a] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:57.333457 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-8eedb9bb-fe0d-43e6-a15d-f1c9b28a86d7 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:57.333940 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-8eedb9bb-fe0d-43e6-a15d-f1c9b28a86d7 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:57.334374 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-8eedb9bb-fe0d-43e6-a15d-f1c9b28a86d7 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:57.335058 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-8eedb9bb-fe0d-43e6-a15d-f1c9b28a86d7 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:57.335510 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-8eedb9bb-fe0d-43e6-a15d-f1c9b28a86d7 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:57.336116 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-8eedb9bb-fe0d-43e6-a15d-f1c9b28a86d7 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:57.464117 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-8eedb9bb-fe0d-43e6-a15d-f1c9b28a86d7 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:57.472364 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-8eedb9bb-fe0d-43e6-a15d-f1c9b28a86d7 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:57.473811 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-8eedb9bb-fe0d-43e6-a15d-f1c9b28a86d7 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:57.474983 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-8eedb9bb-fe0d-43e6-a15d-f1c9b28a86d7 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a" status: 200 len: 1741 microversion: 2.20 time: 0.152493 Oct 28 09:48:57.475545 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 215/422] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:48:57 2022] GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a => generated 1741 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:48:57.824104 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-9481ee7b-e8a0-45a2-80c0-2d609f751448 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:57.824717 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-9481ee7b-e8a0-45a2-80c0-2d609f751448 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] [instance: 525c3586-feef-45c3-a507-eed1ab960107] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:57.830649 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-9481ee7b-e8a0-45a2-80c0-2d609f751448 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:57.831164 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-9481ee7b-e8a0-45a2-80c0-2d609f751448 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:57.831600 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-9481ee7b-e8a0-45a2-80c0-2d609f751448 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:57.832325 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-9481ee7b-e8a0-45a2-80c0-2d609f751448 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:57.832782 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-9481ee7b-e8a0-45a2-80c0-2d609f751448 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:57.833206 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-9481ee7b-e8a0-45a2-80c0-2d609f751448 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:57.966322 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-9481ee7b-e8a0-45a2-80c0-2d609f751448 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c1b55b5c04ba380ed8ffdaa462bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa6bd99403b4421acb8bd714c9450c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:57.973881 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-9481ee7b-e8a0-45a2-80c0-2d609f751448 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] 10.222.0.52 "GET /compute/v2.1/servers/525c3586-feef-45c3-a507-eed1ab960107" status: 200 len: 1313 microversion: 2.1 time: 0.153593 Oct 28 09:48:57.974435 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 208/423] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:48:57 2022] GET /compute/v2.1/servers/525c3586-feef-45c3-a507-eed1ab960107 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:48:58.501968 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-062000e7-b1e2-4f5c-8394-fd336d7fc386 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:58.502679 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-062000e7-b1e2-4f5c-8394-fd336d7fc386 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 6869ffb6-ce4f-4a91-b8d9-7765ea56e95a] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:58.509627 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-062000e7-b1e2-4f5c-8394-fd336d7fc386 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:58.510104 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-062000e7-b1e2-4f5c-8394-fd336d7fc386 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:58.510540 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-062000e7-b1e2-4f5c-8394-fd336d7fc386 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:58.511228 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-062000e7-b1e2-4f5c-8394-fd336d7fc386 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:58.511690 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-062000e7-b1e2-4f5c-8394-fd336d7fc386 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:58.512141 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-062000e7-b1e2-4f5c-8394-fd336d7fc386 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:58.643627 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-062000e7-b1e2-4f5c-8394-fd336d7fc386 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:58.651826 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-062000e7-b1e2-4f5c-8394-fd336d7fc386 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:58.653332 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-062000e7-b1e2-4f5c-8394-fd336d7fc386 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:58.654477 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-062000e7-b1e2-4f5c-8394-fd336d7fc386 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a" status: 200 len: 1741 microversion: 2.20 time: 0.156678 Oct 28 09:48:58.655152 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 216/424] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:48:58 2022] GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a => generated 1741 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:48:58.664289 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-4f2430c8-1f42-48ec-b1cd-1404b4c21101 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:58.664865 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-4f2430c8-1f42-48ec-b1cd-1404b4c21101 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] [instance: 86989378-da9a-4b30-98a7-1ce557ef51cb] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:58.671414 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-4f2430c8-1f42-48ec-b1cd-1404b4c21101 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:58.671948 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-4f2430c8-1f42-48ec-b1cd-1404b4c21101 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:58.672389 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-4f2430c8-1f42-48ec-b1cd-1404b4c21101 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:58.673086 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-4f2430c8-1f42-48ec-b1cd-1404b4c21101 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:58.673534 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-4f2430c8-1f42-48ec-b1cd-1404b4c21101 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:58.673960 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-4f2430c8-1f42-48ec-b1cd-1404b4c21101 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:58.812664 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.objects.instance [None req-4f2430c8-1f42-48ec-b1cd-1404b4c21101 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lazy-loading 'services' on Instance uuid 86989378-da9a-4b30-98a7-1ce557ef51cb {{(pid=127033) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:48:58.902477 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [req-e1365fb3-51e7-4568-8078-5f816ef0a1b1 req-ac50feed-eda6-49a0-88e0-82bf01416707 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "525c3586-feef-45c3-a507-eed1ab960107", "name": "network-vif-plugged", "status": "completed", "tag": "6e1adc0b-821e-4f50-ba74-17de52b39a62"}]} {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:48:58.925947 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-e1365fb3-51e7-4568-8078-5f816ef0a1b1 req-ac50feed-eda6-49a0-88e0-82bf01416707 service nova] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:58.926629 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-e1365fb3-51e7-4568-8078-5f816ef0a1b1 req-ac50feed-eda6-49a0-88e0-82bf01416707 service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:58.927257 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-e1365fb3-51e7-4568-8078-5f816ef0a1b1 req-ac50feed-eda6-49a0-88e0-82bf01416707 service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:58.943138 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.compute.server_external_events [req-e1365fb3-51e7-4568-8078-5f816ef0a1b1 req-ac50feed-eda6-49a0-88e0-82bf01416707 service nova] Creating event network-vif-plugged:6e1adc0b-821e-4f50-ba74-17de52b39a62 for instance 525c3586-feef-45c3-a507-eed1ab960107 on hv-cinder-zed-3 Oct 28 09:48:58.945528 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-4f2430c8-1f42-48ec-b1cd-1404b4c21101 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] 10.222.0.52 "DELETE /compute/v2.1/servers/86989378-da9a-4b30-98a7-1ce557ef51cb/os-volume_attachments/4adfb3fc-0236-45dc-a5b9-1e3c07a57b4b" status: 202 len: 0 microversion: 2.1 time: 0.284827 Oct 28 09:48:58.946748 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 209/425] 10.222.0.52 () {58 vars in 1416 bytes} [Fri Oct 28 09:48:58 2022] DELETE /compute/v2.1/servers/86989378-da9a-4b30-98a7-1ce557ef51cb/os-volume_attachments/4adfb3fc-0236-45dc-a5b9-1e3c07a57b4b => generated 0 bytes in 287 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:48:58.948656 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [req-e1365fb3-51e7-4568-8078-5f816ef0a1b1 req-ac50feed-eda6-49a0-88e0-82bf01416707 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051607 Oct 28 09:48:58.949760 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 217/426] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Oct 28 09:48:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:48:58.999737 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-6415d59c-e7bd-4e96-9350-7dee5b5e799c tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:59.012045 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-6415d59c-e7bd-4e96-9350-7dee5b5e799c tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] [instance: 525c3586-feef-45c3-a507-eed1ab960107] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:59.021626 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-6415d59c-e7bd-4e96-9350-7dee5b5e799c tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:59.022467 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-6415d59c-e7bd-4e96-9350-7dee5b5e799c tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:59.023119 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-6415d59c-e7bd-4e96-9350-7dee5b5e799c tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:59.024265 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-6415d59c-e7bd-4e96-9350-7dee5b5e799c tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:59.024839 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-6415d59c-e7bd-4e96-9350-7dee5b5e799c tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:59.025339 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-6415d59c-e7bd-4e96-9350-7dee5b5e799c tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:59.381847 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-6415d59c-e7bd-4e96-9350-7dee5b5e799c tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c1b55b5c04ba380ed8ffdaa462bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa6bd99403b4421acb8bd714c9450c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:59.389677 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-6415d59c-e7bd-4e96-9350-7dee5b5e799c tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] 10.222.0.52 "GET /compute/v2.1/servers/525c3586-feef-45c3-a507-eed1ab960107" status: 200 len: 1313 microversion: 2.1 time: 0.394246 Oct 28 09:48:59.390246 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 210/427] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:48:58 2022] GET /compute/v2.1/servers/525c3586-feef-45c3-a507-eed1ab960107 => generated 1313 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:48:59.680739 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-340b3520-821e-4b50-88d4-b8044c56e46c tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:59.681437 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-340b3520-821e-4b50-88d4-b8044c56e46c tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 6869ffb6-ce4f-4a91-b8d9-7765ea56e95a] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:48:59.688222 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-340b3520-821e-4b50-88d4-b8044c56e46c tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:59.688708 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-340b3520-821e-4b50-88d4-b8044c56e46c tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:59.689146 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-340b3520-821e-4b50-88d4-b8044c56e46c tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:59.689843 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-340b3520-821e-4b50-88d4-b8044c56e46c tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:59.690296 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-340b3520-821e-4b50-88d4-b8044c56e46c tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:59.690712 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-340b3520-821e-4b50-88d4-b8044c56e46c tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:59.840036 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-340b3520-821e-4b50-88d4-b8044c56e46c tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:59.851432 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-340b3520-821e-4b50-88d4-b8044c56e46c tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:59.855791 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-340b3520-821e-4b50-88d4-b8044c56e46c tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:59.857539 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-340b3520-821e-4b50-88d4-b8044c56e46c tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a" status: 200 len: 1736 microversion: 2.20 time: 0.181376 Oct 28 09:48:59.871974 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 218/428] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:48:59 2022] GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a => generated 1736 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:49:00.084900 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-d6a411eb-10bf-456d-8916-550f07d85950 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:49:00.086017 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-d6a411eb-10bf-456d-8916-550f07d85950 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] [instance: 86989378-da9a-4b30-98a7-1ce557ef51cb] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:49:00.095003 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-d6a411eb-10bf-456d-8916-550f07d85950 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:00.095497 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-d6a411eb-10bf-456d-8916-550f07d85950 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:00.095968 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-d6a411eb-10bf-456d-8916-550f07d85950 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:00.096670 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-d6a411eb-10bf-456d-8916-550f07d85950 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:00.097199 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-d6a411eb-10bf-456d-8916-550f07d85950 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:00.097635 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-d6a411eb-10bf-456d-8916-550f07d85950 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:00.124949 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-d6a411eb-10bf-456d-8916-550f07d85950 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] [instance: 86989378-da9a-4b30-98a7-1ce557ef51cb] Going to try to terminate instance {{(pid=127033) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 09:49:00.219546 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-d6a411eb-10bf-456d-8916-550f07d85950 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] 10.222.0.52 "DELETE /compute/v2.1/servers/86989378-da9a-4b30-98a7-1ce557ef51cb" status: 204 len: 0 microversion: 2.1 time: 0.138057 Oct 28 09:49:00.220602 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 211/429] 10.222.0.52 () {58 vars in 1239 bytes} [Fri Oct 28 09:49:00 2022] DELETE /compute/v2.1/servers/86989378-da9a-4b30-98a7-1ce557ef51cb => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 09:49:00.229490 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-526fadf8-f35e-4543-8149-8bbb84df1653 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:49:00.230367 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-526fadf8-f35e-4543-8149-8bbb84df1653 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] [instance: 86989378-da9a-4b30-98a7-1ce557ef51cb] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:49:00.236749 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-526fadf8-f35e-4543-8149-8bbb84df1653 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:00.237429 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-526fadf8-f35e-4543-8149-8bbb84df1653 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:00.237896 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-526fadf8-f35e-4543-8149-8bbb84df1653 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:00.238566 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-526fadf8-f35e-4543-8149-8bbb84df1653 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:00.239022 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-526fadf8-f35e-4543-8149-8bbb84df1653 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:00.239442 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-526fadf8-f35e-4543-8149-8bbb84df1653 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:00.387823 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-526fadf8-f35e-4543-8149-8bbb84df1653 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36846c3821c14284893e25dd143d11e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1d6189cfd4437a13a0908119c7ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:00.396666 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-526fadf8-f35e-4543-8149-8bbb84df1653 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] 10.222.0.52 "GET /compute/v2.1/servers/86989378-da9a-4b30-98a7-1ce557ef51cb" status: 200 len: 1558 microversion: 2.1 time: 0.171507 Oct 28 09:49:00.397653 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 219/430] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:49:00 2022] GET /compute/v2.1/servers/86989378-da9a-4b30-98a7-1ce557ef51cb => generated 1558 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:49:00.416323 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-9da2e728-5538-4980-b870-ab87daba7d53 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:49:00.417132 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-9da2e728-5538-4980-b870-ab87daba7d53 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] [instance: 525c3586-feef-45c3-a507-eed1ab960107] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:49:00.423605 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-9da2e728-5538-4980-b870-ab87daba7d53 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:00.424124 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-9da2e728-5538-4980-b870-ab87daba7d53 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:00.424556 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-9da2e728-5538-4980-b870-ab87daba7d53 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:00.425249 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-9da2e728-5538-4980-b870-ab87daba7d53 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:00.425700 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-9da2e728-5538-4980-b870-ab87daba7d53 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:00.426116 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-9da2e728-5538-4980-b870-ab87daba7d53 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:00.559478 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-9da2e728-5538-4980-b870-ab87daba7d53 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c1b55b5c04ba380ed8ffdaa462bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa6bd99403b4421acb8bd714c9450c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:00.567209 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-9da2e728-5538-4980-b870-ab87daba7d53 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] 10.222.0.52 "GET /compute/v2.1/servers/525c3586-feef-45c3-a507-eed1ab960107" status: 200 len: 1313 microversion: 2.1 time: 0.157640 Oct 28 09:49:00.567831 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 212/431] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:49:00 2022] GET /compute/v2.1/servers/525c3586-feef-45c3-a507-eed1ab960107 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:49:00.886097 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-40fa68d6-3ceb-4139-8224-9565f6534984 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:49:00.887463 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-40fa68d6-3ceb-4139-8224-9565f6534984 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 6869ffb6-ce4f-4a91-b8d9-7765ea56e95a] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:49:00.894566 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-40fa68d6-3ceb-4139-8224-9565f6534984 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:00.895051 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-40fa68d6-3ceb-4139-8224-9565f6534984 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:00.895520 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-40fa68d6-3ceb-4139-8224-9565f6534984 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:00.896201 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-40fa68d6-3ceb-4139-8224-9565f6534984 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:00.896645 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-40fa68d6-3ceb-4139-8224-9565f6534984 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:00.897057 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-40fa68d6-3ceb-4139-8224-9565f6534984 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:01.047482 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-40fa68d6-3ceb-4139-8224-9565f6534984 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:01.058062 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-40fa68d6-3ceb-4139-8224-9565f6534984 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:01.059572 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-40fa68d6-3ceb-4139-8224-9565f6534984 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:01.060774 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-40fa68d6-3ceb-4139-8224-9565f6534984 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a" status: 200 len: 1736 microversion: 2.20 time: 0.180165 Oct 28 09:49:01.061412 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 220/432] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:49:00 2022] GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a => generated 1736 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:49:01.419853 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-7521d902-e455-4e1e-a6a9-c8a6b4f9d4bf tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:49:01.420511 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-7521d902-e455-4e1e-a6a9-c8a6b4f9d4bf tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] [instance: 86989378-da9a-4b30-98a7-1ce557ef51cb] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:49:01.422318 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG dbcounter [-] [127033] Writing DB stats nova_cell0:SELECT=2 {{(pid=127033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:49:01.428805 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-7521d902-e455-4e1e-a6a9-c8a6b4f9d4bf tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:01.429289 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-7521d902-e455-4e1e-a6a9-c8a6b4f9d4bf tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:01.429720 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-7521d902-e455-4e1e-a6a9-c8a6b4f9d4bf tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:01.430931 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-7521d902-e455-4e1e-a6a9-c8a6b4f9d4bf tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:01.431393 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-7521d902-e455-4e1e-a6a9-c8a6b4f9d4bf tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:01.431849 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-7521d902-e455-4e1e-a6a9-c8a6b4f9d4bf tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:01.570873 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-7521d902-e455-4e1e-a6a9-c8a6b4f9d4bf tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36846c3821c14284893e25dd143d11e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1d6189cfd4437a13a0908119c7ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:01.579677 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-7521d902-e455-4e1e-a6a9-c8a6b4f9d4bf tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] 10.222.0.52 "GET /compute/v2.1/servers/86989378-da9a-4b30-98a7-1ce557ef51cb" status: 200 len: 1512 microversion: 2.1 time: 0.163740 Oct 28 09:49:01.580761 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 213/433] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:49:01 2022] GET /compute/v2.1/servers/86989378-da9a-4b30-98a7-1ce557ef51cb => generated 1512 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:49:01.590503 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-7f89f3f2-e26a-48c3-98f5-c816a711b677 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:49:01.591110 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-7f89f3f2-e26a-48c3-98f5-c816a711b677 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] [instance: 525c3586-feef-45c3-a507-eed1ab960107] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:49:01.597226 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-7f89f3f2-e26a-48c3-98f5-c816a711b677 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:01.597711 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-7f89f3f2-e26a-48c3-98f5-c816a711b677 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:01.598287 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-7f89f3f2-e26a-48c3-98f5-c816a711b677 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:01.598984 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-7f89f3f2-e26a-48c3-98f5-c816a711b677 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:01.599440 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-7f89f3f2-e26a-48c3-98f5-c816a711b677 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:01.599897 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-7f89f3f2-e26a-48c3-98f5-c816a711b677 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:01.602724 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG dbcounter [-] [127032] Writing DB stats nova_cell1:SELECT=100 {{(pid=127032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:49:01.745691 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-7f89f3f2-e26a-48c3-98f5-c816a711b677 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c1b55b5c04ba380ed8ffdaa462bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa6bd99403b4421acb8bd714c9450c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:01.754453 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-7f89f3f2-e26a-48c3-98f5-c816a711b677 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] 10.222.0.52 "GET /compute/v2.1/servers/525c3586-feef-45c3-a507-eed1ab960107" status: 200 len: 1313 microversion: 2.1 time: 0.167474 Oct 28 09:49:01.756103 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 221/434] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:49:01 2022] GET /compute/v2.1/servers/525c3586-feef-45c3-a507-eed1ab960107 => generated 1313 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:49:02.091324 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-38ccd953-cc8b-4bbc-bb49-1baaa40b30ed tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:49:02.091873 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-38ccd953-cc8b-4bbc-bb49-1baaa40b30ed tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 6869ffb6-ce4f-4a91-b8d9-7765ea56e95a] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:49:02.100813 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-38ccd953-cc8b-4bbc-bb49-1baaa40b30ed tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:02.101374 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-38ccd953-cc8b-4bbc-bb49-1baaa40b30ed tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:02.102925 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-38ccd953-cc8b-4bbc-bb49-1baaa40b30ed tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:02.104104 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-38ccd953-cc8b-4bbc-bb49-1baaa40b30ed tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:02.104634 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-38ccd953-cc8b-4bbc-bb49-1baaa40b30ed tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:02.105069 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-38ccd953-cc8b-4bbc-bb49-1baaa40b30ed tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:02.254905 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-38ccd953-cc8b-4bbc-bb49-1baaa40b30ed tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:02.263431 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-38ccd953-cc8b-4bbc-bb49-1baaa40b30ed tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:02.265285 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-38ccd953-cc8b-4bbc-bb49-1baaa40b30ed tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:02.266095 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-38ccd953-cc8b-4bbc-bb49-1baaa40b30ed tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a" status: 200 len: 1736 microversion: 2.20 time: 0.179370 Oct 28 09:49:02.266827 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 214/435] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:49:02 2022] GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a => generated 1736 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:49:02.613346 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-315f4d35-5cb8-4680-8e2c-818c860a230f tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:49:02.616416 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-315f4d35-5cb8-4680-8e2c-818c860a230f tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] [instance: 86989378-da9a-4b30-98a7-1ce557ef51cb] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:49:02.628075 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-315f4d35-5cb8-4680-8e2c-818c860a230f tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:02.629057 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-315f4d35-5cb8-4680-8e2c-818c860a230f tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:02.629933 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-315f4d35-5cb8-4680-8e2c-818c860a230f tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:02.630907 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-315f4d35-5cb8-4680-8e2c-818c860a230f tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:02.636219 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-315f4d35-5cb8-4680-8e2c-818c860a230f tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:02.641059 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-315f4d35-5cb8-4680-8e2c-818c860a230f tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:02.781073 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-1a8b5ff8-9404-4a9b-8d92-7bcf9cec9a97 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:49:02.783543 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-1a8b5ff8-9404-4a9b-8d92-7bcf9cec9a97 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] [instance: 525c3586-feef-45c3-a507-eed1ab960107] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:49:02.791354 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-1a8b5ff8-9404-4a9b-8d92-7bcf9cec9a97 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:02.792156 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-1a8b5ff8-9404-4a9b-8d92-7bcf9cec9a97 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:02.793252 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-1a8b5ff8-9404-4a9b-8d92-7bcf9cec9a97 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:02.794124 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-1a8b5ff8-9404-4a9b-8d92-7bcf9cec9a97 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:02.795518 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-1a8b5ff8-9404-4a9b-8d92-7bcf9cec9a97 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:02.796140 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-1a8b5ff8-9404-4a9b-8d92-7bcf9cec9a97 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:02.826190 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-315f4d35-5cb8-4680-8e2c-818c860a230f tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36846c3821c14284893e25dd143d11e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1d6189cfd4437a13a0908119c7ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:02.834927 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-315f4d35-5cb8-4680-8e2c-818c860a230f tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] 10.222.0.52 "GET /compute/v2.1/servers/86989378-da9a-4b30-98a7-1ce557ef51cb" status: 200 len: 1512 microversion: 2.1 time: 0.234637 Oct 28 09:49:02.852506 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 222/436] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:49:02 2022] GET /compute/v2.1/servers/86989378-da9a-4b30-98a7-1ce557ef51cb => generated 1512 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:49:02.963243 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-1a8b5ff8-9404-4a9b-8d92-7bcf9cec9a97 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c1b55b5c04ba380ed8ffdaa462bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa6bd99403b4421acb8bd714c9450c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:02.976820 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-1a8b5ff8-9404-4a9b-8d92-7bcf9cec9a97 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] 10.222.0.52 "GET /compute/v2.1/servers/525c3586-feef-45c3-a507-eed1ab960107" status: 200 len: 1313 microversion: 2.1 time: 0.202235 Oct 28 09:49:02.994343 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 215/437] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:49:02 2022] GET /compute/v2.1/servers/525c3586-feef-45c3-a507-eed1ab960107 => generated 1313 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:49:03.298622 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-b3a886e1-cb82-42b3-a354-0870c1a36059 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:49:03.298622 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-b3a886e1-cb82-42b3-a354-0870c1a36059 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 6869ffb6-ce4f-4a91-b8d9-7765ea56e95a] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:49:03.300346 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-b3a886e1-cb82-42b3-a354-0870c1a36059 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:03.300999 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-b3a886e1-cb82-42b3-a354-0870c1a36059 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:03.301439 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-b3a886e1-cb82-42b3-a354-0870c1a36059 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:03.302163 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-b3a886e1-cb82-42b3-a354-0870c1a36059 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:03.302633 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-b3a886e1-cb82-42b3-a354-0870c1a36059 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:03.303064 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-b3a886e1-cb82-42b3-a354-0870c1a36059 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:03.455040 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-b3a886e1-cb82-42b3-a354-0870c1a36059 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:03.463500 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-b3a886e1-cb82-42b3-a354-0870c1a36059 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:03.465055 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-b3a886e1-cb82-42b3-a354-0870c1a36059 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:03.466253 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-b3a886e1-cb82-42b3-a354-0870c1a36059 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a" status: 200 len: 1736 microversion: 2.20 time: 0.177949 Oct 28 09:49:03.479949 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 223/438] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:49:03 2022] GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a => generated 1736 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:49:03.863083 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-12b8efdc-6f48-4b99-8888-73d9706c7549 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:49:03.864246 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-12b8efdc-6f48-4b99-8888-73d9706c7549 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] [instance: 86989378-da9a-4b30-98a7-1ce557ef51cb] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:49:03.873787 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-12b8efdc-6f48-4b99-8888-73d9706c7549 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:03.874451 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-12b8efdc-6f48-4b99-8888-73d9706c7549 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:03.874966 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-12b8efdc-6f48-4b99-8888-73d9706c7549 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:03.875946 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-12b8efdc-6f48-4b99-8888-73d9706c7549 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:03.876874 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-12b8efdc-6f48-4b99-8888-73d9706c7549 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:03.877664 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-12b8efdc-6f48-4b99-8888-73d9706c7549 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:04.001684 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-bdb9699a-97bc-4c8f-a5c6-0049607d9d13 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:49:04.003145 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-bdb9699a-97bc-4c8f-a5c6-0049607d9d13 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] [instance: 525c3586-feef-45c3-a507-eed1ab960107] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:49:04.010947 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-bdb9699a-97bc-4c8f-a5c6-0049607d9d13 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:04.011592 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-bdb9699a-97bc-4c8f-a5c6-0049607d9d13 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:04.012369 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-bdb9699a-97bc-4c8f-a5c6-0049607d9d13 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:04.013189 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-bdb9699a-97bc-4c8f-a5c6-0049607d9d13 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:04.013898 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-bdb9699a-97bc-4c8f-a5c6-0049607d9d13 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:04.014546 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-bdb9699a-97bc-4c8f-a5c6-0049607d9d13 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:04.033264 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-12b8efdc-6f48-4b99-8888-73d9706c7549 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36846c3821c14284893e25dd143d11e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1d6189cfd4437a13a0908119c7ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:04.045079 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-12b8efdc-6f48-4b99-8888-73d9706c7549 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] 10.222.0.52 "GET /compute/v2.1/servers/86989378-da9a-4b30-98a7-1ce557ef51cb" status: 200 len: 1512 microversion: 2.1 time: 0.188088 Oct 28 09:49:04.047200 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 216/439] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:49:03 2022] GET /compute/v2.1/servers/86989378-da9a-4b30-98a7-1ce557ef51cb => generated 1512 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:49:04.165227 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-bdb9699a-97bc-4c8f-a5c6-0049607d9d13 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c1b55b5c04ba380ed8ffdaa462bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa6bd99403b4421acb8bd714c9450c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:04.174265 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-bdb9699a-97bc-4c8f-a5c6-0049607d9d13 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] 10.222.0.52 "GET /compute/v2.1/servers/525c3586-feef-45c3-a507-eed1ab960107" status: 200 len: 1313 microversion: 2.1 time: 0.176379 Oct 28 09:49:04.175713 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 224/440] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:49:03 2022] GET /compute/v2.1/servers/525c3586-feef-45c3-a507-eed1ab960107 => generated 1313 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:49:04.492545 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-3cc5bdf3-54ac-41dd-960f-e466d4886371 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:49:04.493642 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-3cc5bdf3-54ac-41dd-960f-e466d4886371 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 6869ffb6-ce4f-4a91-b8d9-7765ea56e95a] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:49:04.500053 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-3cc5bdf3-54ac-41dd-960f-e466d4886371 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:04.500553 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-3cc5bdf3-54ac-41dd-960f-e466d4886371 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:04.501001 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-3cc5bdf3-54ac-41dd-960f-e466d4886371 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:04.501703 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-3cc5bdf3-54ac-41dd-960f-e466d4886371 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:04.502159 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-3cc5bdf3-54ac-41dd-960f-e466d4886371 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:04.502586 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-3cc5bdf3-54ac-41dd-960f-e466d4886371 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:04.658399 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-3cc5bdf3-54ac-41dd-960f-e466d4886371 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:04.667130 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-3cc5bdf3-54ac-41dd-960f-e466d4886371 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:04.668664 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-3cc5bdf3-54ac-41dd-960f-e466d4886371 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:04.669872 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-3cc5bdf3-54ac-41dd-960f-e466d4886371 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a" status: 200 len: 1736 microversion: 2.20 time: 0.181345 Oct 28 09:49:04.670661 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 217/441] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:49:04 2022] GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a => generated 1736 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:49:05.070221 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-f5d522f9-a12e-49b5-b67a-13e49164fff2 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:49:05.070834 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-f5d522f9-a12e-49b5-b67a-13e49164fff2 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] [instance: 86989378-da9a-4b30-98a7-1ce557ef51cb] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:49:05.077597 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-f5d522f9-a12e-49b5-b67a-13e49164fff2 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:05.078082 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-f5d522f9-a12e-49b5-b67a-13e49164fff2 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:05.078543 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-f5d522f9-a12e-49b5-b67a-13e49164fff2 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:05.079232 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-f5d522f9-a12e-49b5-b67a-13e49164fff2 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:05.079690 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-f5d522f9-a12e-49b5-b67a-13e49164fff2 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:05.080131 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-f5d522f9-a12e-49b5-b67a-13e49164fff2 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:05.198936 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-b6100701-b0fb-474e-b2d5-3593aaf78f5f tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:49:05.200480 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-b6100701-b0fb-474e-b2d5-3593aaf78f5f tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] [instance: 525c3586-feef-45c3-a507-eed1ab960107] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:49:05.207737 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-b6100701-b0fb-474e-b2d5-3593aaf78f5f tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:05.208541 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-b6100701-b0fb-474e-b2d5-3593aaf78f5f tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:05.209174 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-b6100701-b0fb-474e-b2d5-3593aaf78f5f tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:05.210144 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-b6100701-b0fb-474e-b2d5-3593aaf78f5f tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:05.210809 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-b6100701-b0fb-474e-b2d5-3593aaf78f5f tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:05.211404 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-b6100701-b0fb-474e-b2d5-3593aaf78f5f tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:05.228450 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-f5d522f9-a12e-49b5-b67a-13e49164fff2 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36846c3821c14284893e25dd143d11e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1d6189cfd4437a13a0908119c7ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:05.242141 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-f5d522f9-a12e-49b5-b67a-13e49164fff2 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] 10.222.0.52 "GET /compute/v2.1/servers/86989378-da9a-4b30-98a7-1ce557ef51cb" status: 200 len: 1512 microversion: 2.1 time: 0.176080 Oct 28 09:49:05.242723 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 225/442] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:49:05 2022] GET /compute/v2.1/servers/86989378-da9a-4b30-98a7-1ce557ef51cb => generated 1512 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:49:05.383650 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-b6100701-b0fb-474e-b2d5-3593aaf78f5f tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c1b55b5c04ba380ed8ffdaa462bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa6bd99403b4421acb8bd714c9450c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:05.391774 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-b6100701-b0fb-474e-b2d5-3593aaf78f5f tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] 10.222.0.52 "GET /compute/v2.1/servers/525c3586-feef-45c3-a507-eed1ab960107" status: 200 len: 1313 microversion: 2.1 time: 0.197141 Oct 28 09:49:05.392352 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 218/443] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:49:05 2022] GET /compute/v2.1/servers/525c3586-feef-45c3-a507-eed1ab960107 => generated 1313 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:49:05.695827 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-b7ea2a20-b4e8-4b2c-aab4-64d8a0f53694 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:49:05.697109 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-b7ea2a20-b4e8-4b2c-aab4-64d8a0f53694 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 6869ffb6-ce4f-4a91-b8d9-7765ea56e95a] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:49:05.703530 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-b7ea2a20-b4e8-4b2c-aab4-64d8a0f53694 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:05.704334 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-b7ea2a20-b4e8-4b2c-aab4-64d8a0f53694 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:05.704702 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-b7ea2a20-b4e8-4b2c-aab4-64d8a0f53694 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:05.705407 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-b7ea2a20-b4e8-4b2c-aab4-64d8a0f53694 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:05.705851 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-b7ea2a20-b4e8-4b2c-aab4-64d8a0f53694 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:05.706442 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-b7ea2a20-b4e8-4b2c-aab4-64d8a0f53694 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:05.853508 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-b7ea2a20-b4e8-4b2c-aab4-64d8a0f53694 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:05.861901 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-b7ea2a20-b4e8-4b2c-aab4-64d8a0f53694 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:05.863333 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-b7ea2a20-b4e8-4b2c-aab4-64d8a0f53694 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:05.864539 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-b7ea2a20-b4e8-4b2c-aab4-64d8a0f53694 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a" status: 200 len: 1736 microversion: 2.20 time: 0.172670 Oct 28 09:49:05.865292 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 226/444] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:49:05 2022] GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a => generated 1736 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:49:06.270149 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-253c29f6-d591-4432-bc93-70851b8ff624 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:49:06.270676 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-253c29f6-d591-4432-bc93-70851b8ff624 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] [instance: 86989378-da9a-4b30-98a7-1ce557ef51cb] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:49:06.278856 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-253c29f6-d591-4432-bc93-70851b8ff624 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:06.279420 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-253c29f6-d591-4432-bc93-70851b8ff624 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:06.279865 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-253c29f6-d591-4432-bc93-70851b8ff624 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:06.280573 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-253c29f6-d591-4432-bc93-70851b8ff624 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:06.281039 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-253c29f6-d591-4432-bc93-70851b8ff624 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:06.281460 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-253c29f6-d591-4432-bc93-70851b8ff624 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:06.416038 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-8c1c98d6-d565-4024-8567-723265547477 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:49:06.417476 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-8c1c98d6-d565-4024-8567-723265547477 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] [instance: 525c3586-feef-45c3-a507-eed1ab960107] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:49:06.423888 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-8c1c98d6-d565-4024-8567-723265547477 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:06.424457 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-8c1c98d6-d565-4024-8567-723265547477 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:06.424994 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-8c1c98d6-d565-4024-8567-723265547477 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:06.426048 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-8c1c98d6-d565-4024-8567-723265547477 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:06.426211 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-8c1c98d6-d565-4024-8567-723265547477 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:06.426726 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-8c1c98d6-d565-4024-8567-723265547477 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:06.433550 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-253c29f6-d591-4432-bc93-70851b8ff624 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36846c3821c14284893e25dd143d11e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1d6189cfd4437a13a0908119c7ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:06.441871 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-253c29f6-d591-4432-bc93-70851b8ff624 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] 10.222.0.52 "GET /compute/v2.1/servers/86989378-da9a-4b30-98a7-1ce557ef51cb" status: 200 len: 1512 microversion: 2.1 time: 0.175701 Oct 28 09:49:06.442543 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 219/445] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:49:06 2022] GET /compute/v2.1/servers/86989378-da9a-4b30-98a7-1ce557ef51cb => generated 1512 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:49:06.597753 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-8c1c98d6-d565-4024-8567-723265547477 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c1b55b5c04ba380ed8ffdaa462bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa6bd99403b4421acb8bd714c9450c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:06.606577 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-8c1c98d6-d565-4024-8567-723265547477 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] 10.222.0.52 "GET /compute/v2.1/servers/525c3586-feef-45c3-a507-eed1ab960107" status: 200 len: 1313 microversion: 2.1 time: 0.194133 Oct 28 09:49:06.616535 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 227/446] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:49:06 2022] GET /compute/v2.1/servers/525c3586-feef-45c3-a507-eed1ab960107 => generated 1313 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:49:06.895189 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-f503ef09-abce-4495-b3db-caefdcdd6d52 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:49:06.895870 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-f503ef09-abce-4495-b3db-caefdcdd6d52 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 6869ffb6-ce4f-4a91-b8d9-7765ea56e95a] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:49:06.902876 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-f503ef09-abce-4495-b3db-caefdcdd6d52 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:06.903356 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-f503ef09-abce-4495-b3db-caefdcdd6d52 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:06.903805 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-f503ef09-abce-4495-b3db-caefdcdd6d52 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:06.904618 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-f503ef09-abce-4495-b3db-caefdcdd6d52 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:06.905068 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-f503ef09-abce-4495-b3db-caefdcdd6d52 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:06.905479 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-f503ef09-abce-4495-b3db-caefdcdd6d52 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:06.910165 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG dbcounter [-] [127033] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:49:07.050759 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-f503ef09-abce-4495-b3db-caefdcdd6d52 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:07.059112 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-f503ef09-abce-4495-b3db-caefdcdd6d52 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:07.060619 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-f503ef09-abce-4495-b3db-caefdcdd6d52 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:07.061871 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-f503ef09-abce-4495-b3db-caefdcdd6d52 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a" status: 200 len: 1736 microversion: 2.20 time: 0.171754 Oct 28 09:49:07.062508 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 220/447] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:49:06 2022] GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a => generated 1736 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:49:07.470394 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-ca2ac6c7-bb74-4413-bb5e-52c3b8cae142 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:49:07.471454 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-ca2ac6c7-bb74-4413-bb5e-52c3b8cae142 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] [instance: 86989378-da9a-4b30-98a7-1ce557ef51cb] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:49:07.478587 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ca2ac6c7-bb74-4413-bb5e-52c3b8cae142 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:07.479250 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ca2ac6c7-bb74-4413-bb5e-52c3b8cae142 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:07.479688 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ca2ac6c7-bb74-4413-bb5e-52c3b8cae142 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:07.480513 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ca2ac6c7-bb74-4413-bb5e-52c3b8cae142 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:07.481498 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ca2ac6c7-bb74-4413-bb5e-52c3b8cae142 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:07.481638 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ca2ac6c7-bb74-4413-bb5e-52c3b8cae142 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:07.631634 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-3ec19079-44d3-4994-b54e-98f6687b4e33 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:49:07.632308 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-3ec19079-44d3-4994-b54e-98f6687b4e33 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] [instance: 525c3586-feef-45c3-a507-eed1ab960107] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:49:07.642029 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-3ec19079-44d3-4994-b54e-98f6687b4e33 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:07.642523 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-3ec19079-44d3-4994-b54e-98f6687b4e33 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:07.642950 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-3ec19079-44d3-4994-b54e-98f6687b4e33 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:07.643647 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-3ec19079-44d3-4994-b54e-98f6687b4e33 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:07.644130 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-3ec19079-44d3-4994-b54e-98f6687b4e33 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:07.644548 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-3ec19079-44d3-4994-b54e-98f6687b4e33 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:07.729173 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-ca2ac6c7-bb74-4413-bb5e-52c3b8cae142 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36846c3821c14284893e25dd143d11e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1d6189cfd4437a13a0908119c7ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:07.738725 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-ca2ac6c7-bb74-4413-bb5e-52c3b8cae142 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] 10.222.0.52 "GET /compute/v2.1/servers/86989378-da9a-4b30-98a7-1ce557ef51cb" status: 200 len: 1512 microversion: 2.1 time: 0.272804 Oct 28 09:49:07.740566 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 228/448] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:49:07 2022] GET /compute/v2.1/servers/86989378-da9a-4b30-98a7-1ce557ef51cb => generated 1512 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:49:07.759980 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [req-5c2c632c-0325-46d1-a833-88a2125aa919 req-a57dd192-9470-401e-b204-7476d750b0c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86989378-da9a-4b30-98a7-1ce557ef51cb", "name": "network-vif-deleted", "tag": "a633e606-b877-4581-904e-1301b95df872"}]} {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:49:07.770446 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-5c2c632c-0325-46d1-a833-88a2125aa919 req-a57dd192-9470-401e-b204-7476d750b0c6 service nova] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:07.770928 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-5c2c632c-0325-46d1-a833-88a2125aa919 req-a57dd192-9470-401e-b204-7476d750b0c6 service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:07.771351 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-5c2c632c-0325-46d1-a833-88a2125aa919 req-a57dd192-9470-401e-b204-7476d750b0c6 service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:07.784243 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.compute.server_external_events [req-5c2c632c-0325-46d1-a833-88a2125aa919 req-a57dd192-9470-401e-b204-7476d750b0c6 service nova] Creating event network-vif-deleted:a633e606-b877-4581-904e-1301b95df872 for instance 86989378-da9a-4b30-98a7-1ce557ef51cb on hv-cinder-zed-3 Oct 28 09:49:07.789838 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [req-5c2c632c-0325-46d1-a833-88a2125aa919 req-a57dd192-9470-401e-b204-7476d750b0c6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036896 Oct 28 09:49:07.795305 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 229/449] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Oct 28 09:49:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:49:07.875681 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-3ec19079-44d3-4994-b54e-98f6687b4e33 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c1b55b5c04ba380ed8ffdaa462bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa6bd99403b4421acb8bd714c9450c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:07.885266 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-3ec19079-44d3-4994-b54e-98f6687b4e33 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] 10.222.0.52 "GET /compute/v2.1/servers/525c3586-feef-45c3-a507-eed1ab960107" status: 200 len: 1497 microversion: 2.1 time: 0.257421 Oct 28 09:49:07.886339 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 221/450] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:49:07 2022] GET /compute/v2.1/servers/525c3586-feef-45c3-a507-eed1ab960107 => generated 1497 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:49:08.092496 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-0275ebb1-811a-4b9b-b98f-2f785e643b3a tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:49:08.093452 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-0275ebb1-811a-4b9b-b98f-2f785e643b3a tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 6869ffb6-ce4f-4a91-b8d9-7765ea56e95a] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:49:08.100689 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-0275ebb1-811a-4b9b-b98f-2f785e643b3a tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:08.101429 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-0275ebb1-811a-4b9b-b98f-2f785e643b3a tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:08.101860 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-0275ebb1-811a-4b9b-b98f-2f785e643b3a tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:08.102768 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-0275ebb1-811a-4b9b-b98f-2f785e643b3a tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:08.103523 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-0275ebb1-811a-4b9b-b98f-2f785e643b3a tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:08.103986 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-0275ebb1-811a-4b9b-b98f-2f785e643b3a tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:08.339412 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-0275ebb1-811a-4b9b-b98f-2f785e643b3a tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:08.350571 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-0275ebb1-811a-4b9b-b98f-2f785e643b3a tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:08.352190 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-0275ebb1-811a-4b9b-b98f-2f785e643b3a tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:08.353995 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-0275ebb1-811a-4b9b-b98f-2f785e643b3a tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a" status: 200 len: 1736 microversion: 2.20 time: 0.267641 Oct 28 09:49:08.354978 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 230/451] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:49:08 2022] GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a => generated 1736 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:49:08.564933 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-5e886acf-a5e8-413a-a8ba-c1abfba5bdf3 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:49:08.565428 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-5e886acf-a5e8-413a-a8ba-c1abfba5bdf3 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] [instance: 525c3586-feef-45c3-a507-eed1ab960107] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:49:08.577567 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-5e886acf-a5e8-413a-a8ba-c1abfba5bdf3 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:08.578425 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-5e886acf-a5e8-413a-a8ba-c1abfba5bdf3 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:08.579086 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-5e886acf-a5e8-413a-a8ba-c1abfba5bdf3 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:08.581373 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-5e886acf-a5e8-413a-a8ba-c1abfba5bdf3 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:08.582515 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-5e886acf-a5e8-413a-a8ba-c1abfba5bdf3 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:08.583011 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-5e886acf-a5e8-413a-a8ba-c1abfba5bdf3 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:08.613426 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-5e886acf-a5e8-413a-a8ba-c1abfba5bdf3 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] [instance: 525c3586-feef-45c3-a507-eed1ab960107] Going to try to terminate instance {{(pid=127033) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 09:49:08.707964 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-5e886acf-a5e8-413a-a8ba-c1abfba5bdf3 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] 10.222.0.52 "DELETE /compute/v2.1/servers/525c3586-feef-45c3-a507-eed1ab960107" status: 204 len: 0 microversion: 2.1 time: 0.144943 Oct 28 09:49:08.708613 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 222/452] 10.222.0.52 () {58 vars in 1239 bytes} [Fri Oct 28 09:49:08 2022] DELETE /compute/v2.1/servers/525c3586-feef-45c3-a507-eed1ab960107 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 09:49:08.717754 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-7e3b866d-444d-4cb3-8268-4d75af9bb29a tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:49:08.718592 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-7e3b866d-444d-4cb3-8268-4d75af9bb29a tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] [instance: 525c3586-feef-45c3-a507-eed1ab960107] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:49:08.725291 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-7e3b866d-444d-4cb3-8268-4d75af9bb29a tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:08.725904 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-7e3b866d-444d-4cb3-8268-4d75af9bb29a tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:08.726595 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-7e3b866d-444d-4cb3-8268-4d75af9bb29a tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:08.727706 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-7e3b866d-444d-4cb3-8268-4d75af9bb29a tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:08.728272 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-7e3b866d-444d-4cb3-8268-4d75af9bb29a tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:08.728769 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-7e3b866d-444d-4cb3-8268-4d75af9bb29a tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:08.767320 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-ec028323-b937-48b1-bf3b-9d3c8ee99431 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:49:08.768043 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-ec028323-b937-48b1-bf3b-9d3c8ee99431 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] [instance: 86989378-da9a-4b30-98a7-1ce557ef51cb] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:49:08.776454 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-ec028323-b937-48b1-bf3b-9d3c8ee99431 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:08.777718 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-ec028323-b937-48b1-bf3b-9d3c8ee99431 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:08.778976 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-ec028323-b937-48b1-bf3b-9d3c8ee99431 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:08.779885 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-ec028323-b937-48b1-bf3b-9d3c8ee99431 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:08.780499 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-ec028323-b937-48b1-bf3b-9d3c8ee99431 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:08.781076 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-ec028323-b937-48b1-bf3b-9d3c8ee99431 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:08.822876 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-ec028323-b937-48b1-bf3b-9d3c8ee99431 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:08.823482 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-ec028323-b937-48b1-bf3b-9d3c8ee99431 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:08.823795 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-ec028323-b937-48b1-bf3b-9d3c8ee99431 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:08.824451 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.objects.instance [None req-ec028323-b937-48b1-bf3b-9d3c8ee99431 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lazy-loading 'fault' on Instance uuid 86989378-da9a-4b30-98a7-1ce557ef51cb {{(pid=127033) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:49:08.893758 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-ec028323-b937-48b1-bf3b-9d3c8ee99431 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36846c3821c14284893e25dd143d11e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1d6189cfd4437a13a0908119c7ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:08.902845 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-ec028323-b937-48b1-bf3b-9d3c8ee99431 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] 10.222.0.52 "GET /compute/v2.1/servers/86989378-da9a-4b30-98a7-1ce557ef51cb" status: 200 len: 1308 microversion: 2.1 time: 0.140038 Oct 28 09:49:08.903422 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 223/453] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:49:08 2022] GET /compute/v2.1/servers/86989378-da9a-4b30-98a7-1ce557ef51cb => generated 1308 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:49:08.923204 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-7e3b866d-444d-4cb3-8268-4d75af9bb29a tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c1b55b5c04ba380ed8ffdaa462bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa6bd99403b4421acb8bd714c9450c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:08.933449 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-7e3b866d-444d-4cb3-8268-4d75af9bb29a tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] 10.222.0.52 "GET /compute/v2.1/servers/525c3586-feef-45c3-a507-eed1ab960107" status: 200 len: 1503 microversion: 2.1 time: 0.219544 Oct 28 09:49:08.934056 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 231/454] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:49:08 2022] GET /compute/v2.1/servers/525c3586-feef-45c3-a507-eed1ab960107 => generated 1503 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:49:09.389704 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-7359d09b-82d2-4075-a5dd-bc2c88596436 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:49:09.390440 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-7359d09b-82d2-4075-a5dd-bc2c88596436 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 6869ffb6-ce4f-4a91-b8d9-7765ea56e95a] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:49:09.396760 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-7359d09b-82d2-4075-a5dd-bc2c88596436 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:09.397385 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-7359d09b-82d2-4075-a5dd-bc2c88596436 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:09.397771 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-7359d09b-82d2-4075-a5dd-bc2c88596436 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:09.398467 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-7359d09b-82d2-4075-a5dd-bc2c88596436 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:09.398948 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-7359d09b-82d2-4075-a5dd-bc2c88596436 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:09.399421 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-7359d09b-82d2-4075-a5dd-bc2c88596436 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:09.542095 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-7359d09b-82d2-4075-a5dd-bc2c88596436 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:09.550937 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-7359d09b-82d2-4075-a5dd-bc2c88596436 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:09.552579 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-7359d09b-82d2-4075-a5dd-bc2c88596436 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:09.553759 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-7359d09b-82d2-4075-a5dd-bc2c88596436 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a" status: 200 len: 1736 microversion: 2.20 time: 0.168014 Oct 28 09:49:09.554332 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 224/455] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:49:09 2022] GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a => generated 1736 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:49:09.925343 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-5b600619-663a-4b29-8ab4-750793174083 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:49:09.925957 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-5b600619-663a-4b29-8ab4-750793174083 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] [instance: 86989378-da9a-4b30-98a7-1ce557ef51cb] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:49:09.934367 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-5b600619-663a-4b29-8ab4-750793174083 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:09.934906 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-5b600619-663a-4b29-8ab4-750793174083 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:09.935368 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-5b600619-663a-4b29-8ab4-750793174083 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:09.936418 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-5b600619-663a-4b29-8ab4-750793174083 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:09.937120 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-5b600619-663a-4b29-8ab4-750793174083 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:09.937767 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-5b600619-663a-4b29-8ab4-750793174083 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:09.958109 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-eb9a4dac-134a-4d3e-a76c-c797254bd1a0 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:49:09.958814 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-eb9a4dac-134a-4d3e-a76c-c797254bd1a0 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] [instance: 525c3586-feef-45c3-a507-eed1ab960107] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:49:09.967578 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-eb9a4dac-134a-4d3e-a76c-c797254bd1a0 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:09.968152 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-eb9a4dac-134a-4d3e-a76c-c797254bd1a0 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:09.968634 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-eb9a4dac-134a-4d3e-a76c-c797254bd1a0 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:09.969364 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-eb9a4dac-134a-4d3e-a76c-c797254bd1a0 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:09.969844 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-eb9a4dac-134a-4d3e-a76c-c797254bd1a0 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:09.970281 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-eb9a4dac-134a-4d3e-a76c-c797254bd1a0 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:10.006112 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-5b600619-663a-4b29-8ab4-750793174083 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:10.006601 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-5b600619-663a-4b29-8ab4-750793174083 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:10.007035 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-5b600619-663a-4b29-8ab4-750793174083 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:10.007488 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.objects.instance [None req-5b600619-663a-4b29-8ab4-750793174083 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lazy-loading 'fault' on Instance uuid 86989378-da9a-4b30-98a7-1ce557ef51cb {{(pid=127032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:49:10.073372 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-5b600619-663a-4b29-8ab4-750793174083 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36846c3821c14284893e25dd143d11e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1d6189cfd4437a13a0908119c7ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:10.082321 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-5b600619-663a-4b29-8ab4-750793174083 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] 10.222.0.52 "GET /compute/v2.1/servers/86989378-da9a-4b30-98a7-1ce557ef51cb" status: 200 len: 1308 microversion: 2.1 time: 0.160841 Oct 28 09:49:10.092111 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 232/456] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:49:09 2022] GET /compute/v2.1/servers/86989378-da9a-4b30-98a7-1ce557ef51cb => generated 1308 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:49:10.177001 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-eb9a4dac-134a-4d3e-a76c-c797254bd1a0 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c1b55b5c04ba380ed8ffdaa462bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa6bd99403b4421acb8bd714c9450c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:10.187677 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-eb9a4dac-134a-4d3e-a76c-c797254bd1a0 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] 10.222.0.52 "GET /compute/v2.1/servers/525c3586-feef-45c3-a507-eed1ab960107" status: 200 len: 1503 microversion: 2.1 time: 0.233284 Oct 28 09:49:10.188281 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 225/457] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:49:09 2022] GET /compute/v2.1/servers/525c3586-feef-45c3-a507-eed1ab960107 => generated 1503 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:49:10.581217 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-bcde981e-bfc4-4fb8-a6d3-c528916dd6b5 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:49:10.581926 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-bcde981e-bfc4-4fb8-a6d3-c528916dd6b5 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 6869ffb6-ce4f-4a91-b8d9-7765ea56e95a] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:49:10.588326 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-bcde981e-bfc4-4fb8-a6d3-c528916dd6b5 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:10.589266 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-bcde981e-bfc4-4fb8-a6d3-c528916dd6b5 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:10.589691 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-bcde981e-bfc4-4fb8-a6d3-c528916dd6b5 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:10.590512 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-bcde981e-bfc4-4fb8-a6d3-c528916dd6b5 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:10.590965 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-bcde981e-bfc4-4fb8-a6d3-c528916dd6b5 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:10.591414 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-bcde981e-bfc4-4fb8-a6d3-c528916dd6b5 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:10.743258 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-bcde981e-bfc4-4fb8-a6d3-c528916dd6b5 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:10.761297 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-bcde981e-bfc4-4fb8-a6d3-c528916dd6b5 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:10.762863 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-bcde981e-bfc4-4fb8-a6d3-c528916dd6b5 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:10.764236 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-bcde981e-bfc4-4fb8-a6d3-c528916dd6b5 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a" status: 200 len: 1736 microversion: 2.20 time: 0.186986 Oct 28 09:49:10.765352 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 233/458] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:49:10 2022] GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a => generated 1736 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:49:11.128026 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-b3721d0b-9dd1-47b3-a88d-43fe28664beb tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:49:11.129187 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-b3721d0b-9dd1-47b3-a88d-43fe28664beb tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] [instance: 86989378-da9a-4b30-98a7-1ce557ef51cb] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:49:11.137597 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-b3721d0b-9dd1-47b3-a88d-43fe28664beb tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:11.138111 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-b3721d0b-9dd1-47b3-a88d-43fe28664beb tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:11.138730 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-b3721d0b-9dd1-47b3-a88d-43fe28664beb tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:11.139307 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-b3721d0b-9dd1-47b3-a88d-43fe28664beb tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:11.140135 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-b3721d0b-9dd1-47b3-a88d-43fe28664beb tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:11.140575 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-b3721d0b-9dd1-47b3-a88d-43fe28664beb tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:11.155582 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.wsgi [None req-b3721d0b-9dd1-47b3-a88d-43fe28664beb tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] HTTP exception thrown: Instance 86989378-da9a-4b30-98a7-1ce557ef51cb could not be found. Oct 28 09:49:11.157285 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-b3721d0b-9dd1-47b3-a88d-43fe28664beb tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Request method failure captured: Oct 28 09:49:11.157285 dv-cinder-zed-3-smb devstack@n-api.service[127033]: request: GET /compute/v2.1/servers/86989378-da9a-4b30-98a7-1ce557ef51cb HTTP/1.1 Oct 28 09:49:11.157285 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Accept: application/json Oct 28 09:49:11.157285 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Accept-Encoding: identity Oct 28 09:49:11.157285 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Connection: close Oct 28 09:49:11.157285 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Content-Length: 0 Oct 28 09:49:11.157285 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Content-Type: application/json Oct 28 09:49:11.157285 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Host: 10.222.0.52 Oct 28 09:49:11.157285 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Openstack-System-Scope: None Oct 28 09:49:11.157285 dv-cinder-zed-3-smb devstack@n-api.service[127033]: User-Agent: python-urllib3/1.26.12 Oct 28 09:49:11.157285 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Auth-Token: gAAAAABjW6UeREZawYM0XxhAV7I0ovB8P-fqeZJFCZISpXyi9qYXYlsKWmn8HSw2DTGwdkvvQONsxRyerfu3yEtCD4eH0d98UozJ7OqPLdn3g_nU7gYfrz9dwNM_1G7h521QnQWOY-fawHwU0VvFaaTNj6Fz8EszUkF9B1LMEn6Ozg_oQqHGIu4 Oct 28 09:49:11.157285 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Domain-Id: None Oct 28 09:49:11.157285 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Domain-Name: None Oct 28 09:49:11.157285 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Identity-Status: Confirmed Oct 28 09:49:11.157285 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Is-Admin-Project: True Oct 28 09:49:11.157285 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Project-Domain-Id: default Oct 28 09:49:11.157285 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Project-Domain-Name: Default Oct 28 09:49:11.157285 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Project-Id: 23f1d6189cfd4437a13a0908119c7ecb Oct 28 09:49:11.157285 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Project-Name: tempest-VolumesSnapshotTestJSON-571579702 Oct 28 09:49:11.157285 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Role: reader,member Oct 28 09:49:11.157285 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Roles: reader,member Oct 28 09:49:11.158912 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_23f1d6189cfd4437a13a0908119c7ecb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/23f1d6189cfd4437a13a0908119c7ecb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/23f1d6189cfd4437a13a0908119c7ecb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/23f1d6189cfd4437a13a0908119c7ecb"}]}] Oct 28 09:49:11.158912 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Tenant: tempest-VolumesSnapshotTestJSON-571579702 Oct 28 09:49:11.158912 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Tenant-Id: 23f1d6189cfd4437a13a0908119c7ecb Oct 28 09:49:11.158912 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-571579702 Oct 28 09:49:11.158912 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User: tempest-VolumesSnapshotTestJSON-571579702-project Oct 28 09:49:11.158912 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User-Domain-Id: default Oct 28 09:49:11.158912 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User-Domain-Name: Default Oct 28 09:49:11.158912 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User-Id: 36846c3821c14284893e25dd143d11e2 Oct 28 09:49:11.158912 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User-Name: tempest-VolumesSnapshotTestJSON-571579702-project Oct 28 09:49:11.158912 dv-cinder-zed-3-smb devstack@n-api.service[127033]: method: > Oct 28 09:49:11.158912 dv-cinder-zed-3-smb devstack@n-api.service[127033]: exception: Instance 86989378-da9a-4b30-98a7-1ce557ef51cb could not be found. Oct 28 09:49:11.158912 dv-cinder-zed-3-smb devstack@n-api.service[127033]: action_args: {'id': '86989378-da9a-4b30-98a7-1ce557ef51cb'} Oct 28 09:49:11.159890 dv-cinder-zed-3-smb devstack@n-api.service[127033]: {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:49:11.159890 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:49:11.159890 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 09:49:11.159890 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 09:49:11.159890 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 09:49:11.159890 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 09:49:11.159890 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 09:49:11.159890 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 09:49:11.159890 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 09:49:11.159890 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 09:49:11.159890 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86989378-da9a-4b30-98a7-1ce557ef51cb could not be found. Oct 28 09:49:11.159890 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:49:11.159890 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:49:11.159890 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:49:11.159890 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:49:11.159890 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:49:11.159890 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:49:11.159890 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:49:11.159890 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:49:11.159890 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:49:11.161428 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:49:11.161428 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 09:49:11.161428 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 09:49:11.161428 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 09:49:11.161428 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 09:49:11.161428 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 09:49:11.161428 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 09:49:11.161428 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86989378-da9a-4b30-98a7-1ce557ef51cb could not be found. Oct 28 09:49:11.161428 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:49:11.161428 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:49:11.161428 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:49:11.161428 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:49:11.161428 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:49:11.161428 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:49:11.161428 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:49:11.161428 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:49:11.161428 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86989378-da9a-4b30-98a7-1ce557ef51cb could not be found. Oct 28 09:49:11.161428 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:49:11.163376 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-b3721d0b-9dd1-47b3-a88d-43fe28664beb tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Returning 404 to user: Instance 86989378-da9a-4b30-98a7-1ce557ef51cb could not be found. {{(pid=127033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:49:11.164335 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-b3721d0b-9dd1-47b3-a88d-43fe28664beb tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] 10.222.0.52 "GET /compute/v2.1/servers/86989378-da9a-4b30-98a7-1ce557ef51cb" status: 404 len: 111 microversion: 2.1 time: 0.061561 Oct 28 09:49:11.164897 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 226/459] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:49:11 2022] GET /compute/v2.1/servers/86989378-da9a-4b30-98a7-1ce557ef51cb => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:49:11.211415 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-411f5d1a-c762-4dd9-aa38-cc6e3f325741 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:49:11.213292 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-411f5d1a-c762-4dd9-aa38-cc6e3f325741 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] [instance: 525c3586-feef-45c3-a507-eed1ab960107] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:49:11.231401 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-411f5d1a-c762-4dd9-aa38-cc6e3f325741 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:11.232264 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-411f5d1a-c762-4dd9-aa38-cc6e3f325741 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:11.233133 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-411f5d1a-c762-4dd9-aa38-cc6e3f325741 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:11.234032 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-411f5d1a-c762-4dd9-aa38-cc6e3f325741 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:11.234498 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-411f5d1a-c762-4dd9-aa38-cc6e3f325741 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:11.234925 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-411f5d1a-c762-4dd9-aa38-cc6e3f325741 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:11.438551 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-411f5d1a-c762-4dd9-aa38-cc6e3f325741 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c1b55b5c04ba380ed8ffdaa462bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa6bd99403b4421acb8bd714c9450c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:11.452722 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-411f5d1a-c762-4dd9-aa38-cc6e3f325741 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] 10.222.0.52 "GET /compute/v2.1/servers/525c3586-feef-45c3-a507-eed1ab960107" status: 200 len: 1503 microversion: 2.1 time: 0.244642 Oct 28 09:49:11.453955 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 234/460] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:49:11 2022] GET /compute/v2.1/servers/525c3586-feef-45c3-a507-eed1ab960107 => generated 1503 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:49:11.649165 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [req-b1dac66e-3967-4d50-a9b8-15c1cbc6e790 req-19b20286-06e2-48aa-81c7-3952bbc16b9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "525c3586-feef-45c3-a507-eed1ab960107", "name": "network-vif-deleted", "tag": "6e1adc0b-821e-4f50-ba74-17de52b39a62"}]} {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:49:11.660497 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-b1dac66e-3967-4d50-a9b8-15c1cbc6e790 req-19b20286-06e2-48aa-81c7-3952bbc16b9f service nova] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:11.660975 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-b1dac66e-3967-4d50-a9b8-15c1cbc6e790 req-19b20286-06e2-48aa-81c7-3952bbc16b9f service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:11.661796 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-b1dac66e-3967-4d50-a9b8-15c1cbc6e790 req-19b20286-06e2-48aa-81c7-3952bbc16b9f service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:11.673786 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.compute.server_external_events [req-b1dac66e-3967-4d50-a9b8-15c1cbc6e790 req-19b20286-06e2-48aa-81c7-3952bbc16b9f service nova] Creating event network-vif-deleted:6e1adc0b-821e-4f50-ba74-17de52b39a62 for instance 525c3586-feef-45c3-a507-eed1ab960107 on hv-cinder-zed-3 Oct 28 09:49:11.679607 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [req-b1dac66e-3967-4d50-a9b8-15c1cbc6e790 req-19b20286-06e2-48aa-81c7-3952bbc16b9f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035306 Oct 28 09:49:11.680632 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 227/461] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Oct 28 09:49:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:49:11.790710 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-e7402fb1-80eb-472e-a5e9-b9fd7ba93829 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:49:11.791433 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-e7402fb1-80eb-472e-a5e9-b9fd7ba93829 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 6869ffb6-ce4f-4a91-b8d9-7765ea56e95a] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:49:11.797804 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-e7402fb1-80eb-472e-a5e9-b9fd7ba93829 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:11.798372 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-e7402fb1-80eb-472e-a5e9-b9fd7ba93829 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:11.798909 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-e7402fb1-80eb-472e-a5e9-b9fd7ba93829 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:11.799673 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-e7402fb1-80eb-472e-a5e9-b9fd7ba93829 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:11.800223 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-e7402fb1-80eb-472e-a5e9-b9fd7ba93829 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:11.800726 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-e7402fb1-80eb-472e-a5e9-b9fd7ba93829 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:11.957808 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-e7402fb1-80eb-472e-a5e9-b9fd7ba93829 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:11.966847 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-e7402fb1-80eb-472e-a5e9-b9fd7ba93829 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:11.969260 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-e7402fb1-80eb-472e-a5e9-b9fd7ba93829 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:11.970470 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-e7402fb1-80eb-472e-a5e9-b9fd7ba93829 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a" status: 200 len: 1736 microversion: 2.20 time: 0.183862 Oct 28 09:49:11.971031 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 235/462] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:49:11 2022] GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a => generated 1736 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:49:12.478596 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-f9797cd8-0a1b-4dfd-bba1-87fd9d3c5e40 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:49:12.479491 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-f9797cd8-0a1b-4dfd-bba1-87fd9d3c5e40 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] [instance: 525c3586-feef-45c3-a507-eed1ab960107] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:49:12.486123 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-f9797cd8-0a1b-4dfd-bba1-87fd9d3c5e40 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:12.486645 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-f9797cd8-0a1b-4dfd-bba1-87fd9d3c5e40 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:12.487220 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-f9797cd8-0a1b-4dfd-bba1-87fd9d3c5e40 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:12.488223 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-f9797cd8-0a1b-4dfd-bba1-87fd9d3c5e40 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:12.488683 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-f9797cd8-0a1b-4dfd-bba1-87fd9d3c5e40 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:12.489151 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-f9797cd8-0a1b-4dfd-bba1-87fd9d3c5e40 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:12.524219 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-f9797cd8-0a1b-4dfd-bba1-87fd9d3c5e40 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:12.524748 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-f9797cd8-0a1b-4dfd-bba1-87fd9d3c5e40 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:12.525282 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-f9797cd8-0a1b-4dfd-bba1-87fd9d3c5e40 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:12.525728 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.objects.instance [None req-f9797cd8-0a1b-4dfd-bba1-87fd9d3c5e40 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lazy-loading 'fault' on Instance uuid 525c3586-feef-45c3-a507-eed1ab960107 {{(pid=127033) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:49:12.575032 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-f9797cd8-0a1b-4dfd-bba1-87fd9d3c5e40 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c1b55b5c04ba380ed8ffdaa462bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa6bd99403b4421acb8bd714c9450c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:12.582015 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-f9797cd8-0a1b-4dfd-bba1-87fd9d3c5e40 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] 10.222.0.52 "GET /compute/v2.1/servers/525c3586-feef-45c3-a507-eed1ab960107" status: 200 len: 1303 microversion: 2.1 time: 0.108660 Oct 28 09:49:12.595768 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 228/463] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:49:12 2022] GET /compute/v2.1/servers/525c3586-feef-45c3-a507-eed1ab960107 => generated 1303 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:49:12.996772 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-b319efba-4a22-4b3a-82f8-d2900e67a744 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:49:12.997365 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-b319efba-4a22-4b3a-82f8-d2900e67a744 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 6869ffb6-ce4f-4a91-b8d9-7765ea56e95a] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:49:13.003725 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-b319efba-4a22-4b3a-82f8-d2900e67a744 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:13.004237 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-b319efba-4a22-4b3a-82f8-d2900e67a744 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:13.004671 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-b319efba-4a22-4b3a-82f8-d2900e67a744 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:13.005360 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-b319efba-4a22-4b3a-82f8-d2900e67a744 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:13.005816 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-b319efba-4a22-4b3a-82f8-d2900e67a744 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:13.006240 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-b319efba-4a22-4b3a-82f8-d2900e67a744 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:13.140303 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-b319efba-4a22-4b3a-82f8-d2900e67a744 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:13.148338 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-b319efba-4a22-4b3a-82f8-d2900e67a744 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:13.149823 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-b319efba-4a22-4b3a-82f8-d2900e67a744 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:13.150952 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-b319efba-4a22-4b3a-82f8-d2900e67a744 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a" status: 200 len: 1736 microversion: 2.20 time: 0.158749 Oct 28 09:49:13.151504 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 236/464] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:49:12 2022] GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:49:13.606441 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-8b3cee85-d71c-4943-8fa9-1d7f2f8de098 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:49:13.607059 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-8b3cee85-d71c-4943-8fa9-1d7f2f8de098 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] [instance: 525c3586-feef-45c3-a507-eed1ab960107] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:49:13.613760 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-8b3cee85-d71c-4943-8fa9-1d7f2f8de098 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:13.614249 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-8b3cee85-d71c-4943-8fa9-1d7f2f8de098 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:13.614684 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-8b3cee85-d71c-4943-8fa9-1d7f2f8de098 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:13.615378 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-8b3cee85-d71c-4943-8fa9-1d7f2f8de098 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:13.615866 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-8b3cee85-d71c-4943-8fa9-1d7f2f8de098 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:13.616310 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-8b3cee85-d71c-4943-8fa9-1d7f2f8de098 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:13.630243 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.wsgi [None req-8b3cee85-d71c-4943-8fa9-1d7f2f8de098 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] HTTP exception thrown: Instance 525c3586-feef-45c3-a507-eed1ab960107 could not be found. Oct 28 09:49:13.631921 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-8b3cee85-d71c-4943-8fa9-1d7f2f8de098 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Request method failure captured: Oct 28 09:49:13.631921 dv-cinder-zed-3-smb devstack@n-api.service[127033]: request: GET /compute/v2.1/servers/525c3586-feef-45c3-a507-eed1ab960107 HTTP/1.1 Oct 28 09:49:13.631921 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Accept: application/json Oct 28 09:49:13.631921 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Accept-Encoding: identity Oct 28 09:49:13.631921 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Connection: close Oct 28 09:49:13.631921 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Content-Length: 0 Oct 28 09:49:13.631921 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Content-Type: application/json Oct 28 09:49:13.631921 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Host: 10.222.0.52 Oct 28 09:49:13.631921 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Openstack-System-Scope: None Oct 28 09:49:13.631921 dv-cinder-zed-3-smb devstack@n-api.service[127033]: User-Agent: python-urllib3/1.26.12 Oct 28 09:49:13.631921 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Auth-Token: gAAAAABjW6VLb6EBITV9bHp6A2GJk-hzUdEQ9_G8nPBfUTKUnilpPDOdUpEvXSY3kDYY3yrYt4ZeCzUSgx1omprydhhQ5Pbu4pBGgGfmPzT_0S7ENz9VEhuh5orQHSvad9tnz3nfx-XnWQoueUl7vx44mrsF6VEaG1T5qDIX7am22gViUnHs3X8 Oct 28 09:49:13.631921 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Domain-Id: None Oct 28 09:49:13.631921 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Domain-Name: None Oct 28 09:49:13.631921 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Identity-Status: Confirmed Oct 28 09:49:13.631921 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Is-Admin-Project: True Oct 28 09:49:13.631921 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Project-Domain-Id: default Oct 28 09:49:13.631921 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Project-Domain-Name: Default Oct 28 09:49:13.631921 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Project-Id: 2aa6bd99403b4421acb8bd714c9450c6 Oct 28 09:49:13.631921 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Project-Name: tempest-VolumesActionsTest-397101613 Oct 28 09:49:13.631921 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Role: reader,member Oct 28 09:49:13.631921 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Roles: reader,member Oct 28 09:49:13.633347 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2aa6bd99403b4421acb8bd714c9450c6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2aa6bd99403b4421acb8bd714c9450c6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2aa6bd99403b4421acb8bd714c9450c6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2aa6bd99403b4421acb8bd714c9450c6"}]}] Oct 28 09:49:13.633347 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Tenant: tempest-VolumesActionsTest-397101613 Oct 28 09:49:13.633347 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Tenant-Id: 2aa6bd99403b4421acb8bd714c9450c6 Oct 28 09:49:13.633347 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Tenant-Name: tempest-VolumesActionsTest-397101613 Oct 28 09:49:13.633347 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User: tempest-VolumesActionsTest-397101613-project Oct 28 09:49:13.633347 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User-Domain-Id: default Oct 28 09:49:13.633347 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User-Domain-Name: Default Oct 28 09:49:13.633347 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User-Id: d10c1b55b5c04ba380ed8ffdaa462bc7 Oct 28 09:49:13.633347 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User-Name: tempest-VolumesActionsTest-397101613-project Oct 28 09:49:13.633347 dv-cinder-zed-3-smb devstack@n-api.service[127033]: method: > Oct 28 09:49:13.633347 dv-cinder-zed-3-smb devstack@n-api.service[127033]: exception: Instance 525c3586-feef-45c3-a507-eed1ab960107 could not be found. Oct 28 09:49:13.633347 dv-cinder-zed-3-smb devstack@n-api.service[127033]: action_args: {'id': '525c3586-feef-45c3-a507-eed1ab960107'} Oct 28 09:49:13.634772 dv-cinder-zed-3-smb devstack@n-api.service[127033]: {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:49:13.634772 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:49:13.634772 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 09:49:13.634772 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 09:49:13.634772 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 09:49:13.634772 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 09:49:13.634772 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 09:49:13.634772 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 09:49:13.634772 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 09:49:13.634772 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 09:49:13.634772 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 525c3586-feef-45c3-a507-eed1ab960107 could not be found. Oct 28 09:49:13.634772 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:49:13.634772 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:49:13.634772 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:49:13.634772 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:49:13.634772 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:49:13.634772 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:49:13.634772 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:49:13.634772 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:49:13.634772 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:49:13.636039 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:49:13.636039 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 09:49:13.636039 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 09:49:13.636039 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 09:49:13.636039 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 09:49:13.636039 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 09:49:13.636039 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 09:49:13.636039 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 525c3586-feef-45c3-a507-eed1ab960107 could not be found. Oct 28 09:49:13.636039 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:49:13.636039 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:49:13.636039 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:49:13.636039 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:49:13.636039 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:49:13.636039 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:49:13.636039 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:49:13.636039 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:49:13.636039 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 525c3586-feef-45c3-a507-eed1ab960107 could not be found. Oct 28 09:49:13.636039 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:49:13.639026 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-8b3cee85-d71c-4943-8fa9-1d7f2f8de098 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] Returning 404 to user: Instance 525c3586-feef-45c3-a507-eed1ab960107 could not be found. {{(pid=127033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:49:13.639026 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-8b3cee85-d71c-4943-8fa9-1d7f2f8de098 tempest-VolumesActionsTest-397101613 tempest-VolumesActionsTest-397101613-project] 10.222.0.52 "GET /compute/v2.1/servers/525c3586-feef-45c3-a507-eed1ab960107" status: 404 len: 111 microversion: 2.1 time: 0.030819 Oct 28 09:49:13.639026 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 229/465] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:49:13 2022] GET /compute/v2.1/servers/525c3586-feef-45c3-a507-eed1ab960107 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:49:14.175975 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-1c64beb5-ac96-41e5-b657-40ab1355a94e tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:49:14.176584 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-1c64beb5-ac96-41e5-b657-40ab1355a94e tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 6869ffb6-ce4f-4a91-b8d9-7765ea56e95a] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:49:14.184656 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-1c64beb5-ac96-41e5-b657-40ab1355a94e tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:14.184944 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-1c64beb5-ac96-41e5-b657-40ab1355a94e tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:14.185377 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-1c64beb5-ac96-41e5-b657-40ab1355a94e tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:14.186074 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-1c64beb5-ac96-41e5-b657-40ab1355a94e tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:14.186513 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-1c64beb5-ac96-41e5-b657-40ab1355a94e tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:14.186948 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-1c64beb5-ac96-41e5-b657-40ab1355a94e tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:14.319298 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-1c64beb5-ac96-41e5-b657-40ab1355a94e tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:14.328333 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-1c64beb5-ac96-41e5-b657-40ab1355a94e tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:14.329763 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-1c64beb5-ac96-41e5-b657-40ab1355a94e tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:14.330898 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-1c64beb5-ac96-41e5-b657-40ab1355a94e tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a" status: 200 len: 1718 microversion: 2.20 time: 0.159179 Oct 28 09:49:14.331681 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 237/466] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:49:14 2022] GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a => generated 1718 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:49:15.007840 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-2e38f539-6681-4eb1-83b0-9fcfb7e146fd tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-365185520", "imageRef": "6e314146-a2ed-4f8b-afdd-4f7ed1184d20", "flavorRef": "452", "networks": [{"uuid": "1cd861d2-007f-4e5c-8db8-b92530b04cbf"}]}} {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:49:15.062915 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.network.neutron [None req-2e38f539-6681-4eb1-83b0-9fcfb7e146fd tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] validate_networks() for [('1cd861d2-007f-4e5c-8db8-b92530b04cbf', None, None, None, None, None)] {{(pid=127033) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 09:49:15.358245 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-ff025686-5c3c-4dd5-84e2-99912944f37e tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:49:15.358821 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-ff025686-5c3c-4dd5-84e2-99912944f37e tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 6869ffb6-ce4f-4a91-b8d9-7765ea56e95a] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:49:15.365152 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ff025686-5c3c-4dd5-84e2-99912944f37e tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:15.365626 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ff025686-5c3c-4dd5-84e2-99912944f37e tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:15.366055 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ff025686-5c3c-4dd5-84e2-99912944f37e tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:15.366740 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ff025686-5c3c-4dd5-84e2-99912944f37e tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:15.367190 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ff025686-5c3c-4dd5-84e2-99912944f37e tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:15.367598 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ff025686-5c3c-4dd5-84e2-99912944f37e tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:15.371901 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG dbcounter [-] [127032] Writing DB stats nova_cell1:SELECT=100 {{(pid=127032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:49:15.445617 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.virt.hardware [None req-2e38f539-6681-4eb1-83b0-9fcfb7e146fd tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Flavor limits 0:0:0 {{(pid=127033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 09:49:15.448488 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.virt.hardware [None req-2e38f539-6681-4eb1-83b0-9fcfb7e146fd tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Image limits 0:0:0 {{(pid=127033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 09:49:15.449065 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.virt.hardware [None req-2e38f539-6681-4eb1-83b0-9fcfb7e146fd tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Flavor pref 0:0:0 {{(pid=127033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 09:49:15.449481 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.virt.hardware [None req-2e38f539-6681-4eb1-83b0-9fcfb7e146fd tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Image pref 0:0:0 {{(pid=127033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 09:49:15.450126 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.virt.hardware [None req-2e38f539-6681-4eb1-83b0-9fcfb7e146fd tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 09:49:15.452651 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG dbcounter [-] [127033] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=127033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:49:15.460830 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-2e38f539-6681-4eb1-83b0-9fcfb7e146fd tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:15.461335 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-2e38f539-6681-4eb1-83b0-9fcfb7e146fd tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:15.461746 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-2e38f539-6681-4eb1-83b0-9fcfb7e146fd tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:15.463197 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-2e38f539-6681-4eb1-83b0-9fcfb7e146fd tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:15.463574 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-2e38f539-6681-4eb1-83b0-9fcfb7e146fd tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:15.464381 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-2e38f539-6681-4eb1-83b0-9fcfb7e146fd tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:15.483803 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.quota [None req-2e38f539-6681-4eb1-83b0-9fcfb7e146fd tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Getting quotas for project 23f1d6189cfd4437a13a0908119c7ecb. Resources: {'cores', 'ram', 'instances'} {{(pid=127033) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 09:49:15.488668 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.quota [None req-2e38f539-6681-4eb1-83b0-9fcfb7e146fd tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Getting quotas for user 36846c3821c14284893e25dd143d11e2 and project 23f1d6189cfd4437a13a0908119c7ecb. Resources: {'cores', 'ram', 'instances'} {{(pid=127033) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 09:49:15.501381 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-2e38f539-6681-4eb1-83b0-9fcfb7e146fd tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Going to run 1 instances... {{(pid=127033) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 09:49:15.504027 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-2e38f539-6681-4eb1-83b0-9fcfb7e146fd tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] [instance: 59cbacea-5702-4207-a63b-6ebc3f652dac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e314146-a2ed-4f8b-afdd-4f7ed1184d20',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127033) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 09:49:15.535684 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-ff025686-5c3c-4dd5-84e2-99912944f37e tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:15.546439 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-ff025686-5c3c-4dd5-84e2-99912944f37e tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:15.548228 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-ff025686-5c3c-4dd5-84e2-99912944f37e tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:15.549395 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-ff025686-5c3c-4dd5-84e2-99912944f37e tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a" status: 200 len: 1718 microversion: 2.20 time: 0.195318 Oct 28 09:49:15.549943 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 238/467] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:49:15 2022] GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a => generated 1718 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:49:15.554833 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-2e38f539-6681-4eb1-83b0-9fcfb7e146fd tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.550776 Oct 28 09:49:15.559785 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 230/468] 10.222.0.52 () {60 vars in 1147 bytes} [Fri Oct 28 09:49:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 552 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 09:49:15.567360 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-9fe86898-9698-48b6-b74b-c2a35f3e4f86 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:49:15.567987 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-9fe86898-9698-48b6-b74b-c2a35f3e4f86 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] [instance: 59cbacea-5702-4207-a63b-6ebc3f652dac] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:49:15.569847 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG dbcounter [-] [127032] Writing DB stats nova_api:SELECT=96 {{(pid=127032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:49:15.633739 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-9fe86898-9698-48b6-b74b-c2a35f3e4f86 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36846c3821c14284893e25dd143d11e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1d6189cfd4437a13a0908119c7ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:15.649667 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-9fe86898-9698-48b6-b74b-c2a35f3e4f86 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] 10.222.0.52 "GET /compute/v2.1/servers/59cbacea-5702-4207-a63b-6ebc3f652dac" status: 200 len: 1218 microversion: 2.1 time: 0.085462 Oct 28 09:49:15.652421 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 239/469] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:49:15 2022] GET /compute/v2.1/servers/59cbacea-5702-4207-a63b-6ebc3f652dac => generated 1218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:49:16.580852 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-6f6cbd74-8b9f-42de-a5e4-872d0a2143c7 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:49:16.582094 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-6f6cbd74-8b9f-42de-a5e4-872d0a2143c7 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 6869ffb6-ce4f-4a91-b8d9-7765ea56e95a] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:49:16.602399 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-6f6cbd74-8b9f-42de-a5e4-872d0a2143c7 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:16.603566 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-6f6cbd74-8b9f-42de-a5e4-872d0a2143c7 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:16.604140 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-6f6cbd74-8b9f-42de-a5e4-872d0a2143c7 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:16.604967 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-6f6cbd74-8b9f-42de-a5e4-872d0a2143c7 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:16.605531 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-6f6cbd74-8b9f-42de-a5e4-872d0a2143c7 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:16.606058 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-6f6cbd74-8b9f-42de-a5e4-872d0a2143c7 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:16.674951 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-4dfc71ef-07cb-49e8-a0c8-b7afb3054207 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:49:16.676354 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-4dfc71ef-07cb-49e8-a0c8-b7afb3054207 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] [instance: 59cbacea-5702-4207-a63b-6ebc3f652dac] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:49:16.687124 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-4dfc71ef-07cb-49e8-a0c8-b7afb3054207 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:16.689775 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-4dfc71ef-07cb-49e8-a0c8-b7afb3054207 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:16.690743 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-4dfc71ef-07cb-49e8-a0c8-b7afb3054207 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:16.696809 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-4dfc71ef-07cb-49e8-a0c8-b7afb3054207 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:16.698005 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-4dfc71ef-07cb-49e8-a0c8-b7afb3054207 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:16.700717 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-4dfc71ef-07cb-49e8-a0c8-b7afb3054207 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:16.834925 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-4dfc71ef-07cb-49e8-a0c8-b7afb3054207 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36846c3821c14284893e25dd143d11e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1d6189cfd4437a13a0908119c7ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:16.848946 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-4dfc71ef-07cb-49e8-a0c8-b7afb3054207 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] 10.222.0.52 "GET /compute/v2.1/servers/59cbacea-5702-4207-a63b-6ebc3f652dac" status: 200 len: 1270 microversion: 2.1 time: 0.178748 Oct 28 09:49:16.849883 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 240/470] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:49:16 2022] GET /compute/v2.1/servers/59cbacea-5702-4207-a63b-6ebc3f652dac => generated 1270 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:49:16.875371 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-6f6cbd74-8b9f-42de-a5e4-872d0a2143c7 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:16.889376 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-6f6cbd74-8b9f-42de-a5e4-872d0a2143c7 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:16.894483 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-6f6cbd74-8b9f-42de-a5e4-872d0a2143c7 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:16.898499 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-6f6cbd74-8b9f-42de-a5e4-872d0a2143c7 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a" status: 200 len: 1661 microversion: 2.20 time: 0.324018 Oct 28 09:49:16.912013 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 231/471] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:49:16 2022] GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a => generated 1661 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:49:16.926734 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-07c33a63-fed1-4825-95aa-b361c94ca19b tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "523ea4ad-db65-4384-aba4-44e9532e0171"}} {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:49:16.929300 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-07c33a63-fed1-4825-95aa-b361c94ca19b tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 6869ffb6-ce4f-4a91-b8d9-7765ea56e95a] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:49:16.940577 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-07c33a63-fed1-4825-95aa-b361c94ca19b tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:16.945039 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-07c33a63-fed1-4825-95aa-b361c94ca19b tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:16.945514 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-07c33a63-fed1-4825-95aa-b361c94ca19b tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:16.946277 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-07c33a63-fed1-4825-95aa-b361c94ca19b tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:16.946730 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-07c33a63-fed1-4825-95aa-b361c94ca19b tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:16.947434 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-07c33a63-fed1-4825-95aa-b361c94ca19b tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:17.118519 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [req-c55310c6-2e0d-4edd-9cab-cd5a45b48c6f req-fdfb8dc3-3365-4249-8d45-3342d7a9c814 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6869ffb6-ce4f-4a91-b8d9-7765ea56e95a", "name": "network-vif-unplugged", "status": "completed", "tag": "f350d1f8-ff54-4a77-b413-0023d0d49856"}]} {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:49:17.137121 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-c55310c6-2e0d-4edd-9cab-cd5a45b48c6f req-fdfb8dc3-3365-4249-8d45-3342d7a9c814 service nova] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:17.137612 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-c55310c6-2e0d-4edd-9cab-cd5a45b48c6f req-fdfb8dc3-3365-4249-8d45-3342d7a9c814 service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:17.140665 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-c55310c6-2e0d-4edd-9cab-cd5a45b48c6f req-fdfb8dc3-3365-4249-8d45-3342d7a9c814 service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:17.173488 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.compute.server_external_events [req-c55310c6-2e0d-4edd-9cab-cd5a45b48c6f req-fdfb8dc3-3365-4249-8d45-3342d7a9c814 service nova] Unable to find a host for instance 6869ffb6-ce4f-4a91-b8d9-7765ea56e95a. Dropping event network-vif-unplugged {{(pid=127033) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 28 09:49:17.180264 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [req-c55310c6-2e0d-4edd-9cab-cd5a45b48c6f req-fdfb8dc3-3365-4249-8d45-3342d7a9c814 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.060825 Oct 28 09:49:17.181664 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 232/472] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Oct 28 09:49:17 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 68 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 28 09:49:17.373830 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-07c33a63-fed1-4825-95aa-b361c94ca19b tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "POST /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.451243 Oct 28 09:49:17.376667 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 241/473] 10.222.0.52 () {62 vars in 1364 bytes} [Fri Oct 28 09:49:16 2022] POST /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a/os-volume_attachments => generated 188 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 09:49:17.589965 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-e0546cce-a4cf-48ed-8d21-cc57383a43c1 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:49:17.591303 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-e0546cce-a4cf-48ed-8d21-cc57383a43c1 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 6869ffb6-ce4f-4a91-b8d9-7765ea56e95a] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:49:17.597831 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-e0546cce-a4cf-48ed-8d21-cc57383a43c1 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:17.598649 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-e0546cce-a4cf-48ed-8d21-cc57383a43c1 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:17.599289 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-e0546cce-a4cf-48ed-8d21-cc57383a43c1 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:17.600258 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-e0546cce-a4cf-48ed-8d21-cc57383a43c1 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:17.600938 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-e0546cce-a4cf-48ed-8d21-cc57383a43c1 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:17.601583 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-e0546cce-a4cf-48ed-8d21-cc57383a43c1 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:17.664151 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-e0546cce-a4cf-48ed-8d21-cc57383a43c1 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 6869ffb6-ce4f-4a91-b8d9-7765ea56e95a] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127033) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 28 09:49:17.880445 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-546a0669-2285-4e22-b0fb-9fb4c21f52ce tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:49:17.882578 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-546a0669-2285-4e22-b0fb-9fb4c21f52ce tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] [instance: 59cbacea-5702-4207-a63b-6ebc3f652dac] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:49:17.894358 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-e0546cce-a4cf-48ed-8d21-cc57383a43c1 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "POST /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a/action" status: 202 len: 0 microversion: 2.20 time: 0.308493 Oct 28 09:49:17.898063 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 233/474] 10.222.0.52 () {62 vars in 1319 bytes} [Fri Oct 28 09:49:17 2022] POST /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a/action => generated 0 bytes in 311 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 28 09:49:17.906190 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-9b0852d8-510f-4d14-ba53-f811388b1f1c tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:49:17.906802 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-9b0852d8-510f-4d14-ba53-f811388b1f1c tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 6869ffb6-ce4f-4a91-b8d9-7765ea56e95a] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:49:17.927990 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-9b0852d8-510f-4d14-ba53-f811388b1f1c tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:17.928521 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-9b0852d8-510f-4d14-ba53-f811388b1f1c tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:17.929334 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-9b0852d8-510f-4d14-ba53-f811388b1f1c tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:17.932139 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-9b0852d8-510f-4d14-ba53-f811388b1f1c tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:17.932296 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-546a0669-2285-4e22-b0fb-9fb4c21f52ce tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:17.932770 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-9b0852d8-510f-4d14-ba53-f811388b1f1c tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:17.932908 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-546a0669-2285-4e22-b0fb-9fb4c21f52ce tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:17.933204 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-9b0852d8-510f-4d14-ba53-f811388b1f1c tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:17.933329 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-546a0669-2285-4e22-b0fb-9fb4c21f52ce tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:17.933902 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-546a0669-2285-4e22-b0fb-9fb4c21f52ce tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:17.942670 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-546a0669-2285-4e22-b0fb-9fb4c21f52ce tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:17.944836 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-546a0669-2285-4e22-b0fb-9fb4c21f52ce tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:18.036737 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-546a0669-2285-4e22-b0fb-9fb4c21f52ce tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36846c3821c14284893e25dd143d11e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1d6189cfd4437a13a0908119c7ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:18.058794 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-546a0669-2285-4e22-b0fb-9fb4c21f52ce tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] 10.222.0.52 "GET /compute/v2.1/servers/59cbacea-5702-4207-a63b-6ebc3f652dac" status: 200 len: 1276 microversion: 2.1 time: 0.183381 Oct 28 09:49:18.079823 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 242/475] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:49:17 2022] GET /compute/v2.1/servers/59cbacea-5702-4207-a63b-6ebc3f652dac => generated 1276 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:49:18.234544 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-9b0852d8-510f-4d14-ba53-f811388b1f1c tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:18.246277 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-9b0852d8-510f-4d14-ba53-f811388b1f1c tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:18.248025 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-9b0852d8-510f-4d14-ba53-f811388b1f1c tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:18.249290 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-9b0852d8-510f-4d14-ba53-f811388b1f1c tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a" status: 200 len: 1747 microversion: 2.20 time: 0.349957 Oct 28 09:49:18.256108 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 234/476] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:49:17 2022] GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a => generated 1747 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:49:19.093517 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-75214a70-2a7d-4a3f-861f-08a828b298f9 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:49:19.094720 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-75214a70-2a7d-4a3f-861f-08a828b298f9 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] [instance: 59cbacea-5702-4207-a63b-6ebc3f652dac] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:49:19.110496 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-75214a70-2a7d-4a3f-861f-08a828b298f9 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:19.110995 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-75214a70-2a7d-4a3f-861f-08a828b298f9 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:19.111440 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-75214a70-2a7d-4a3f-861f-08a828b298f9 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:19.112190 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-75214a70-2a7d-4a3f-861f-08a828b298f9 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:19.112837 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-75214a70-2a7d-4a3f-861f-08a828b298f9 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:19.118416 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-75214a70-2a7d-4a3f-861f-08a828b298f9 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:19.274492 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-f15e1204-7315-4619-852e-e6f040ad73d1 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:49:19.275132 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-f15e1204-7315-4619-852e-e6f040ad73d1 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 6869ffb6-ce4f-4a91-b8d9-7765ea56e95a] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:49:19.285114 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-f15e1204-7315-4619-852e-e6f040ad73d1 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:19.285617 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-f15e1204-7315-4619-852e-e6f040ad73d1 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:19.291905 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-f15e1204-7315-4619-852e-e6f040ad73d1 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:19.292720 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-f15e1204-7315-4619-852e-e6f040ad73d1 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:19.293227 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-f15e1204-7315-4619-852e-e6f040ad73d1 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:19.293632 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-f15e1204-7315-4619-852e-e6f040ad73d1 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:19.303006 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-75214a70-2a7d-4a3f-861f-08a828b298f9 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36846c3821c14284893e25dd143d11e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1d6189cfd4437a13a0908119c7ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:19.312426 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-75214a70-2a7d-4a3f-861f-08a828b298f9 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] 10.222.0.52 "GET /compute/v2.1/servers/59cbacea-5702-4207-a63b-6ebc3f652dac" status: 200 len: 1318 microversion: 2.1 time: 0.222644 Oct 28 09:49:19.313015 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 243/477] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:49:19 2022] GET /compute/v2.1/servers/59cbacea-5702-4207-a63b-6ebc3f652dac => generated 1318 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:49:19.573165 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-f15e1204-7315-4619-852e-e6f040ad73d1 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:19.588674 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-f15e1204-7315-4619-852e-e6f040ad73d1 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:19.590457 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-f15e1204-7315-4619-852e-e6f040ad73d1 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:19.592026 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-f15e1204-7315-4619-852e-e6f040ad73d1 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a" status: 200 len: 1747 microversion: 2.20 time: 0.321484 Oct 28 09:49:19.606969 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 235/478] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:49:19 2022] GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a => generated 1747 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:49:20.081365 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [req-de95982e-4500-4b62-a063-7b216b9e2b2d req-3e03ac8c-57a4-4047-8916-6b22b82c8c55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59cbacea-5702-4207-a63b-6ebc3f652dac", "tag": "4cb8c638-6008-4746-b380-34937ebffc1b"}]} {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:49:20.101350 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-de95982e-4500-4b62-a063-7b216b9e2b2d req-3e03ac8c-57a4-4047-8916-6b22b82c8c55 service nova] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:20.102075 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-de95982e-4500-4b62-a063-7b216b9e2b2d req-3e03ac8c-57a4-4047-8916-6b22b82c8c55 service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:20.102599 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-de95982e-4500-4b62-a063-7b216b9e2b2d req-3e03ac8c-57a4-4047-8916-6b22b82c8c55 service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:20.154933 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.compute.server_external_events [req-de95982e-4500-4b62-a063-7b216b9e2b2d req-3e03ac8c-57a4-4047-8916-6b22b82c8c55 service nova] Creating event network-changed:4cb8c638-6008-4746-b380-34937ebffc1b for instance 59cbacea-5702-4207-a63b-6ebc3f652dac on hv-cinder-zed-3 Oct 28 09:49:20.165554 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [req-de95982e-4500-4b62-a063-7b216b9e2b2d req-3e03ac8c-57a4-4047-8916-6b22b82c8c55 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089248 Oct 28 09:49:20.166820 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 244/479] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Oct 28 09:49:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:49:20.339334 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-abc8395c-49d0-4068-ac7e-a677269db9e3 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:49:20.340574 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-abc8395c-49d0-4068-ac7e-a677269db9e3 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] [instance: 59cbacea-5702-4207-a63b-6ebc3f652dac] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:49:20.354822 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-abc8395c-49d0-4068-ac7e-a677269db9e3 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:20.356008 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-abc8395c-49d0-4068-ac7e-a677269db9e3 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:20.356824 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-abc8395c-49d0-4068-ac7e-a677269db9e3 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:20.358305 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-abc8395c-49d0-4068-ac7e-a677269db9e3 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:20.359071 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-abc8395c-49d0-4068-ac7e-a677269db9e3 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:20.367198 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-abc8395c-49d0-4068-ac7e-a677269db9e3 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:20.556413 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-abc8395c-49d0-4068-ac7e-a677269db9e3 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36846c3821c14284893e25dd143d11e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1d6189cfd4437a13a0908119c7ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:20.563460 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG dbcounter [-] [127033] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:49:20.578542 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-abc8395c-49d0-4068-ac7e-a677269db9e3 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] 10.222.0.52 "GET /compute/v2.1/servers/59cbacea-5702-4207-a63b-6ebc3f652dac" status: 200 len: 1318 microversion: 2.1 time: 0.244177 Oct 28 09:49:20.588523 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 236/480] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:49:20 2022] GET /compute/v2.1/servers/59cbacea-5702-4207-a63b-6ebc3f652dac => generated 1318 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:49:20.639110 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-62d925a4-41fb-4a8d-8f35-e031e161f4b9 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:49:20.640067 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-62d925a4-41fb-4a8d-8f35-e031e161f4b9 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 6869ffb6-ce4f-4a91-b8d9-7765ea56e95a] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:49:20.650281 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-62d925a4-41fb-4a8d-8f35-e031e161f4b9 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:20.651188 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-62d925a4-41fb-4a8d-8f35-e031e161f4b9 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:20.651958 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-62d925a4-41fb-4a8d-8f35-e031e161f4b9 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:20.652873 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-62d925a4-41fb-4a8d-8f35-e031e161f4b9 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:20.653690 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-62d925a4-41fb-4a8d-8f35-e031e161f4b9 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:20.654609 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-62d925a4-41fb-4a8d-8f35-e031e161f4b9 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:20.814808 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-62d925a4-41fb-4a8d-8f35-e031e161f4b9 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:20.827768 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-62d925a4-41fb-4a8d-8f35-e031e161f4b9 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:20.830069 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-62d925a4-41fb-4a8d-8f35-e031e161f4b9 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:20.831533 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-62d925a4-41fb-4a8d-8f35-e031e161f4b9 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a" status: 200 len: 1749 microversion: 2.20 time: 0.196665 Oct 28 09:49:20.845690 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 245/481] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:49:20 2022] GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a => generated 1749 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:49:21.605896 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-37a7cd68-edea-4fc5-a24a-a4f143e38cbb tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:49:21.606671 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-37a7cd68-edea-4fc5-a24a-a4f143e38cbb tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] [instance: 59cbacea-5702-4207-a63b-6ebc3f652dac] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:49:21.616997 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-37a7cd68-edea-4fc5-a24a-a4f143e38cbb tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:21.617715 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-37a7cd68-edea-4fc5-a24a-a4f143e38cbb tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:21.618242 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-37a7cd68-edea-4fc5-a24a-a4f143e38cbb tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:21.619006 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-37a7cd68-edea-4fc5-a24a-a4f143e38cbb tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:21.619661 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-37a7cd68-edea-4fc5-a24a-a4f143e38cbb tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:21.620287 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-37a7cd68-edea-4fc5-a24a-a4f143e38cbb tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:21.768861 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-37a7cd68-edea-4fc5-a24a-a4f143e38cbb tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36846c3821c14284893e25dd143d11e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1d6189cfd4437a13a0908119c7ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:21.780740 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-37a7cd68-edea-4fc5-a24a-a4f143e38cbb tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] 10.222.0.52 "GET /compute/v2.1/servers/59cbacea-5702-4207-a63b-6ebc3f652dac" status: 200 len: 1318 microversion: 2.1 time: 0.179193 Oct 28 09:49:21.782099 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 237/482] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:49:21 2022] GET /compute/v2.1/servers/59cbacea-5702-4207-a63b-6ebc3f652dac => generated 1318 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:49:21.862584 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-2deab478-7d80-4a18-94f4-d2231ed3dc66 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:49:21.864023 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-2deab478-7d80-4a18-94f4-d2231ed3dc66 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 6869ffb6-ce4f-4a91-b8d9-7765ea56e95a] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:49:21.871179 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-2deab478-7d80-4a18-94f4-d2231ed3dc66 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:21.871985 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-2deab478-7d80-4a18-94f4-d2231ed3dc66 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:21.872635 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-2deab478-7d80-4a18-94f4-d2231ed3dc66 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:21.873556 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-2deab478-7d80-4a18-94f4-d2231ed3dc66 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:21.874037 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-2deab478-7d80-4a18-94f4-d2231ed3dc66 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:21.874486 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-2deab478-7d80-4a18-94f4-d2231ed3dc66 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:22.048288 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-2deab478-7d80-4a18-94f4-d2231ed3dc66 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:22.060399 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-2deab478-7d80-4a18-94f4-d2231ed3dc66 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:22.062467 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-2deab478-7d80-4a18-94f4-d2231ed3dc66 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:22.064117 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-2deab478-7d80-4a18-94f4-d2231ed3dc66 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a" status: 200 len: 1805 microversion: 2.20 time: 0.205991 Oct 28 09:49:22.065075 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 246/483] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:49:21 2022] GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a => generated 1805 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:49:22.806674 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-4877c11b-2c5b-4f6c-8777-056f83fad0f1 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:49:22.807468 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-4877c11b-2c5b-4f6c-8777-056f83fad0f1 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] [instance: 59cbacea-5702-4207-a63b-6ebc3f652dac] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:49:22.815404 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-4877c11b-2c5b-4f6c-8777-056f83fad0f1 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:22.815948 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-4877c11b-2c5b-4f6c-8777-056f83fad0f1 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:22.816486 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-4877c11b-2c5b-4f6c-8777-056f83fad0f1 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:22.817231 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-4877c11b-2c5b-4f6c-8777-056f83fad0f1 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:22.817766 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-4877c11b-2c5b-4f6c-8777-056f83fad0f1 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:22.818182 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-4877c11b-2c5b-4f6c-8777-056f83fad0f1 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:23.006057 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-4877c11b-2c5b-4f6c-8777-056f83fad0f1 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36846c3821c14284893e25dd143d11e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1d6189cfd4437a13a0908119c7ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:23.020014 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-4877c11b-2c5b-4f6c-8777-056f83fad0f1 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] 10.222.0.52 "GET /compute/v2.1/servers/59cbacea-5702-4207-a63b-6ebc3f652dac" status: 200 len: 1318 microversion: 2.1 time: 0.218422 Oct 28 09:49:23.021188 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 238/484] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:49:22 2022] GET /compute/v2.1/servers/59cbacea-5702-4207-a63b-6ebc3f652dac => generated 1318 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:49:23.099234 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-0039d47c-e5c2-490a-a130-69e429afb6ac tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:49:23.100421 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-0039d47c-e5c2-490a-a130-69e429afb6ac tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 6869ffb6-ce4f-4a91-b8d9-7765ea56e95a] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:49:23.111954 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-0039d47c-e5c2-490a-a130-69e429afb6ac tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:23.112889 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-0039d47c-e5c2-490a-a130-69e429afb6ac tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:23.113604 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-0039d47c-e5c2-490a-a130-69e429afb6ac tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:23.114783 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-0039d47c-e5c2-490a-a130-69e429afb6ac tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:23.115595 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-0039d47c-e5c2-490a-a130-69e429afb6ac tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:23.116448 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-0039d47c-e5c2-490a-a130-69e429afb6ac tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:23.343380 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-0039d47c-e5c2-490a-a130-69e429afb6ac tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:23.360713 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-0039d47c-e5c2-490a-a130-69e429afb6ac tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:23.363808 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-0039d47c-e5c2-490a-a130-69e429afb6ac tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:23.366026 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-0039d47c-e5c2-490a-a130-69e429afb6ac tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a" status: 200 len: 1805 microversion: 2.20 time: 0.273955 Oct 28 09:49:23.367618 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 247/485] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:49:23 2022] GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a => generated 1805 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:49:24.043342 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-00d3fd54-c61e-4fb2-9adb-12a7ec34048e tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:49:24.044651 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-00d3fd54-c61e-4fb2-9adb-12a7ec34048e tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] [instance: 59cbacea-5702-4207-a63b-6ebc3f652dac] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:49:24.052242 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-00d3fd54-c61e-4fb2-9adb-12a7ec34048e tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:24.053842 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-00d3fd54-c61e-4fb2-9adb-12a7ec34048e tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:24.054543 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-00d3fd54-c61e-4fb2-9adb-12a7ec34048e tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:24.055726 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-00d3fd54-c61e-4fb2-9adb-12a7ec34048e tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:24.056457 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-00d3fd54-c61e-4fb2-9adb-12a7ec34048e tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:24.057114 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-00d3fd54-c61e-4fb2-9adb-12a7ec34048e tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:24.214626 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-00d3fd54-c61e-4fb2-9adb-12a7ec34048e tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36846c3821c14284893e25dd143d11e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1d6189cfd4437a13a0908119c7ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:24.223325 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-00d3fd54-c61e-4fb2-9adb-12a7ec34048e tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] 10.222.0.52 "GET /compute/v2.1/servers/59cbacea-5702-4207-a63b-6ebc3f652dac" status: 200 len: 1318 microversion: 2.1 time: 0.184389 Oct 28 09:49:24.228354 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 239/486] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:49:24 2022] GET /compute/v2.1/servers/59cbacea-5702-4207-a63b-6ebc3f652dac => generated 1318 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:49:24.415701 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-edca1939-0f80-4549-9180-09414bc5dcdf tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:49:24.416386 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-edca1939-0f80-4549-9180-09414bc5dcdf tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 6869ffb6-ce4f-4a91-b8d9-7765ea56e95a] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:49:24.423876 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-edca1939-0f80-4549-9180-09414bc5dcdf tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:24.424776 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-edca1939-0f80-4549-9180-09414bc5dcdf tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:24.425459 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-edca1939-0f80-4549-9180-09414bc5dcdf tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:24.426410 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-edca1939-0f80-4549-9180-09414bc5dcdf tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:24.427003 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-edca1939-0f80-4549-9180-09414bc5dcdf tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:24.427500 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-edca1939-0f80-4549-9180-09414bc5dcdf tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:24.653576 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-edca1939-0f80-4549-9180-09414bc5dcdf tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:24.663584 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-edca1939-0f80-4549-9180-09414bc5dcdf tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:24.665261 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-edca1939-0f80-4549-9180-09414bc5dcdf tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:24.666553 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-edca1939-0f80-4549-9180-09414bc5dcdf tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a" status: 200 len: 1805 microversion: 2.20 time: 0.255416 Oct 28 09:49:24.667661 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 248/487] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:49:24 2022] GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a => generated 1805 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:49:25.247255 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-6ab483a4-730b-45c2-9086-50a1daac5835 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:49:25.248561 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-6ab483a4-730b-45c2-9086-50a1daac5835 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] [instance: 59cbacea-5702-4207-a63b-6ebc3f652dac] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:49:25.255237 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-6ab483a4-730b-45c2-9086-50a1daac5835 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:25.255980 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-6ab483a4-730b-45c2-9086-50a1daac5835 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:25.256432 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-6ab483a4-730b-45c2-9086-50a1daac5835 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:25.257116 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-6ab483a4-730b-45c2-9086-50a1daac5835 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:25.257737 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-6ab483a4-730b-45c2-9086-50a1daac5835 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:25.258163 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-6ab483a4-730b-45c2-9086-50a1daac5835 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:25.402598 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-6ab483a4-730b-45c2-9086-50a1daac5835 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36846c3821c14284893e25dd143d11e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1d6189cfd4437a13a0908119c7ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:25.414062 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-6ab483a4-730b-45c2-9086-50a1daac5835 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] 10.222.0.52 "GET /compute/v2.1/servers/59cbacea-5702-4207-a63b-6ebc3f652dac" status: 200 len: 1318 microversion: 2.1 time: 0.171232 Oct 28 09:49:25.414770 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 240/488] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:49:25 2022] GET /compute/v2.1/servers/59cbacea-5702-4207-a63b-6ebc3f652dac => generated 1318 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:49:25.698079 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-1c390ef7-ed3c-4a7c-a194-064f431e692d tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:49:25.698708 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-1c390ef7-ed3c-4a7c-a194-064f431e692d tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 6869ffb6-ce4f-4a91-b8d9-7765ea56e95a] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:49:25.701118 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG dbcounter [-] [127032] Writing DB stats nova_cell0:SELECT=2 {{(pid=127032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:49:25.709793 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-1c390ef7-ed3c-4a7c-a194-064f431e692d tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:25.710282 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-1c390ef7-ed3c-4a7c-a194-064f431e692d tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:25.710711 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-1c390ef7-ed3c-4a7c-a194-064f431e692d tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:25.711422 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-1c390ef7-ed3c-4a7c-a194-064f431e692d tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:25.711930 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-1c390ef7-ed3c-4a7c-a194-064f431e692d tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:25.712599 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-1c390ef7-ed3c-4a7c-a194-064f431e692d tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:25.872577 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-1c390ef7-ed3c-4a7c-a194-064f431e692d tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:25.883289 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-1c390ef7-ed3c-4a7c-a194-064f431e692d tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:25.885293 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-1c390ef7-ed3c-4a7c-a194-064f431e692d tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:25.886803 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-1c390ef7-ed3c-4a7c-a194-064f431e692d tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a" status: 200 len: 1805 microversion: 2.20 time: 0.193452 Oct 28 09:49:25.887576 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 249/489] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:49:25 2022] GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a => generated 1805 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:49:26.438237 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-e83b1f5c-9274-4b37-8665-ba0d8f290317 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:49:26.439674 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-e83b1f5c-9274-4b37-8665-ba0d8f290317 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] [instance: 59cbacea-5702-4207-a63b-6ebc3f652dac] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:49:26.451775 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG dbcounter [-] [127033] Writing DB stats nova_cell0:SELECT=2 {{(pid=127033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:49:26.455966 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG dbcounter [-] [127033] Writing DB stats nova_cell0:SELECT=6 {{(pid=127033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:49:26.462752 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-e83b1f5c-9274-4b37-8665-ba0d8f290317 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:26.465596 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-e83b1f5c-9274-4b37-8665-ba0d8f290317 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:26.467131 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-e83b1f5c-9274-4b37-8665-ba0d8f290317 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:26.469968 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-e83b1f5c-9274-4b37-8665-ba0d8f290317 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:26.470768 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-e83b1f5c-9274-4b37-8665-ba0d8f290317 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:26.472640 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-e83b1f5c-9274-4b37-8665-ba0d8f290317 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:26.771513 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-e83b1f5c-9274-4b37-8665-ba0d8f290317 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36846c3821c14284893e25dd143d11e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1d6189cfd4437a13a0908119c7ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:26.780099 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-e83b1f5c-9274-4b37-8665-ba0d8f290317 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] 10.222.0.52 "GET /compute/v2.1/servers/59cbacea-5702-4207-a63b-6ebc3f652dac" status: 200 len: 1318 microversion: 2.1 time: 0.345872 Oct 28 09:49:26.781760 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 241/490] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:49:26 2022] GET /compute/v2.1/servers/59cbacea-5702-4207-a63b-6ebc3f652dac => generated 1318 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:49:26.916942 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-10e75833-799d-4023-a20c-f6d63aade329 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:49:26.917777 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-10e75833-799d-4023-a20c-f6d63aade329 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 6869ffb6-ce4f-4a91-b8d9-7765ea56e95a] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:49:26.935799 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-10e75833-799d-4023-a20c-f6d63aade329 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:26.938250 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-10e75833-799d-4023-a20c-f6d63aade329 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:26.938725 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-10e75833-799d-4023-a20c-f6d63aade329 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:26.942320 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-10e75833-799d-4023-a20c-f6d63aade329 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:26.944415 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-10e75833-799d-4023-a20c-f6d63aade329 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:26.947001 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-10e75833-799d-4023-a20c-f6d63aade329 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:27.236224 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-10e75833-799d-4023-a20c-f6d63aade329 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:27.245958 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-10e75833-799d-4023-a20c-f6d63aade329 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:27.248948 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-10e75833-799d-4023-a20c-f6d63aade329 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:27.250310 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-10e75833-799d-4023-a20c-f6d63aade329 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a" status: 200 len: 1805 microversion: 2.20 time: 0.340610 Oct 28 09:49:27.251391 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 250/491] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:49:26 2022] GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a => generated 1805 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:49:27.809194 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-63137796-aa59-4b6d-87d4-8613779b4185 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:49:27.809887 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-63137796-aa59-4b6d-87d4-8613779b4185 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] [instance: 59cbacea-5702-4207-a63b-6ebc3f652dac] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:49:27.817055 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-63137796-aa59-4b6d-87d4-8613779b4185 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:27.817869 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-63137796-aa59-4b6d-87d4-8613779b4185 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:27.818509 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-63137796-aa59-4b6d-87d4-8613779b4185 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:27.819468 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-63137796-aa59-4b6d-87d4-8613779b4185 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:27.820318 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-63137796-aa59-4b6d-87d4-8613779b4185 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:27.821067 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-63137796-aa59-4b6d-87d4-8613779b4185 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:28.107225 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-63137796-aa59-4b6d-87d4-8613779b4185 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36846c3821c14284893e25dd143d11e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1d6189cfd4437a13a0908119c7ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:28.120305 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-63137796-aa59-4b6d-87d4-8613779b4185 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] 10.222.0.52 "GET /compute/v2.1/servers/59cbacea-5702-4207-a63b-6ebc3f652dac" status: 200 len: 1318 microversion: 2.1 time: 0.315418 Oct 28 09:49:28.121109 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 242/492] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:49:27 2022] GET /compute/v2.1/servers/59cbacea-5702-4207-a63b-6ebc3f652dac => generated 1318 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:49:28.278854 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-8e4e4fe9-bc96-4dc4-b1bc-89c36c9a9eb8 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:49:28.280461 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-8e4e4fe9-bc96-4dc4-b1bc-89c36c9a9eb8 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 6869ffb6-ce4f-4a91-b8d9-7765ea56e95a] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:49:28.288428 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-8e4e4fe9-bc96-4dc4-b1bc-89c36c9a9eb8 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:28.289280 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-8e4e4fe9-bc96-4dc4-b1bc-89c36c9a9eb8 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:28.289724 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-8e4e4fe9-bc96-4dc4-b1bc-89c36c9a9eb8 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:28.291269 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-8e4e4fe9-bc96-4dc4-b1bc-89c36c9a9eb8 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:28.291775 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-8e4e4fe9-bc96-4dc4-b1bc-89c36c9a9eb8 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:28.292559 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-8e4e4fe9-bc96-4dc4-b1bc-89c36c9a9eb8 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:28.504771 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-8e4e4fe9-bc96-4dc4-b1bc-89c36c9a9eb8 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:28.516533 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-8e4e4fe9-bc96-4dc4-b1bc-89c36c9a9eb8 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:28.517983 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-8e4e4fe9-bc96-4dc4-b1bc-89c36c9a9eb8 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:28.519160 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-8e4e4fe9-bc96-4dc4-b1bc-89c36c9a9eb8 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a" status: 200 len: 1805 microversion: 2.20 time: 0.244262 Oct 28 09:49:28.520075 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 251/493] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:49:28 2022] GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a => generated 1805 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:49:29.158626 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-bf9c2ae8-63bd-480e-8c9a-27e5307c93a4 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:49:29.161149 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-bf9c2ae8-63bd-480e-8c9a-27e5307c93a4 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] [instance: 59cbacea-5702-4207-a63b-6ebc3f652dac] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:49:29.175345 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-bf9c2ae8-63bd-480e-8c9a-27e5307c93a4 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:29.176457 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-bf9c2ae8-63bd-480e-8c9a-27e5307c93a4 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:29.177128 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-bf9c2ae8-63bd-480e-8c9a-27e5307c93a4 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:29.178331 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-bf9c2ae8-63bd-480e-8c9a-27e5307c93a4 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:29.179042 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-bf9c2ae8-63bd-480e-8c9a-27e5307c93a4 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:29.180319 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-bf9c2ae8-63bd-480e-8c9a-27e5307c93a4 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:29.362035 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-bf9c2ae8-63bd-480e-8c9a-27e5307c93a4 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36846c3821c14284893e25dd143d11e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1d6189cfd4437a13a0908119c7ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:29.370851 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-bf9c2ae8-63bd-480e-8c9a-27e5307c93a4 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] 10.222.0.52 "GET /compute/v2.1/servers/59cbacea-5702-4207-a63b-6ebc3f652dac" status: 200 len: 1318 microversion: 2.1 time: 0.220903 Oct 28 09:49:29.387846 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 243/494] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:49:29 2022] GET /compute/v2.1/servers/59cbacea-5702-4207-a63b-6ebc3f652dac => generated 1318 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:49:29.477150 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [req-8e38ae9e-64ae-4ba3-993b-028b1e1262ca req-d7ddee49-13af-473a-9174-702833f7c89b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59cbacea-5702-4207-a63b-6ebc3f652dac", "name": "network-vif-plugged", "status": "completed", "tag": "4cb8c638-6008-4746-b380-34937ebffc1b"}]} {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:49:29.494213 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-8e38ae9e-64ae-4ba3-993b-028b1e1262ca req-d7ddee49-13af-473a-9174-702833f7c89b service nova] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:29.494973 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-8e38ae9e-64ae-4ba3-993b-028b1e1262ca req-d7ddee49-13af-473a-9174-702833f7c89b service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:29.495580 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-8e38ae9e-64ae-4ba3-993b-028b1e1262ca req-d7ddee49-13af-473a-9174-702833f7c89b service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:29.517588 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.compute.server_external_events [req-8e38ae9e-64ae-4ba3-993b-028b1e1262ca req-d7ddee49-13af-473a-9174-702833f7c89b service nova] Creating event network-vif-plugged:4cb8c638-6008-4746-b380-34937ebffc1b for instance 59cbacea-5702-4207-a63b-6ebc3f652dac on hv-cinder-zed-3 Oct 28 09:49:29.524000 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [req-8e38ae9e-64ae-4ba3-993b-028b1e1262ca req-d7ddee49-13af-473a-9174-702833f7c89b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052853 Oct 28 09:49:29.526836 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 252/495] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Oct 28 09:49:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:49:29.548477 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-af5fc236-2789-4934-aa1b-e8ed46680a32 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:49:29.549080 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-af5fc236-2789-4934-aa1b-e8ed46680a32 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 6869ffb6-ce4f-4a91-b8d9-7765ea56e95a] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:49:29.568578 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-af5fc236-2789-4934-aa1b-e8ed46680a32 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:29.570650 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-af5fc236-2789-4934-aa1b-e8ed46680a32 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:29.572912 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-af5fc236-2789-4934-aa1b-e8ed46680a32 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:29.576273 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-af5fc236-2789-4934-aa1b-e8ed46680a32 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:29.579848 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-af5fc236-2789-4934-aa1b-e8ed46680a32 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:29.580785 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-af5fc236-2789-4934-aa1b-e8ed46680a32 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:29.920992 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-af5fc236-2789-4934-aa1b-e8ed46680a32 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:29.937961 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-af5fc236-2789-4934-aa1b-e8ed46680a32 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:29.941566 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-af5fc236-2789-4934-aa1b-e8ed46680a32 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:29.943618 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-af5fc236-2789-4934-aa1b-e8ed46680a32 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a" status: 200 len: 1805 microversion: 2.20 time: 0.400770 Oct 28 09:49:29.944883 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 244/496] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:49:29 2022] GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a => generated 1805 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:49:30.401168 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-522b3dbe-4f75-4e12-8c7b-7ad645b0c0a6 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:49:30.402197 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-522b3dbe-4f75-4e12-8c7b-7ad645b0c0a6 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] [instance: 59cbacea-5702-4207-a63b-6ebc3f652dac] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:49:30.415195 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-522b3dbe-4f75-4e12-8c7b-7ad645b0c0a6 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:30.415828 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-522b3dbe-4f75-4e12-8c7b-7ad645b0c0a6 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:30.416234 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-522b3dbe-4f75-4e12-8c7b-7ad645b0c0a6 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:30.416957 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-522b3dbe-4f75-4e12-8c7b-7ad645b0c0a6 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:30.417434 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-522b3dbe-4f75-4e12-8c7b-7ad645b0c0a6 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:30.417878 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-522b3dbe-4f75-4e12-8c7b-7ad645b0c0a6 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:30.767539 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-522b3dbe-4f75-4e12-8c7b-7ad645b0c0a6 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36846c3821c14284893e25dd143d11e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1d6189cfd4437a13a0908119c7ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:30.776899 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-522b3dbe-4f75-4e12-8c7b-7ad645b0c0a6 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] 10.222.0.52 "GET /compute/v2.1/servers/59cbacea-5702-4207-a63b-6ebc3f652dac" status: 200 len: 1318 microversion: 2.1 time: 0.381658 Oct 28 09:49:30.778224 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 253/497] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:49:30 2022] GET /compute/v2.1/servers/59cbacea-5702-4207-a63b-6ebc3f652dac => generated 1318 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:49:30.971707 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-5b3581b8-4326-4984-85f6-4e17402b262f tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:49:30.973211 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-5b3581b8-4326-4984-85f6-4e17402b262f tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 6869ffb6-ce4f-4a91-b8d9-7765ea56e95a] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:49:30.981901 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-5b3581b8-4326-4984-85f6-4e17402b262f tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:30.982593 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-5b3581b8-4326-4984-85f6-4e17402b262f tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:30.983687 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-5b3581b8-4326-4984-85f6-4e17402b262f tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:30.990867 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-5b3581b8-4326-4984-85f6-4e17402b262f tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:30.991393 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-5b3581b8-4326-4984-85f6-4e17402b262f tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:30.991876 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-5b3581b8-4326-4984-85f6-4e17402b262f tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:31.186095 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-5b3581b8-4326-4984-85f6-4e17402b262f tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:31.198822 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-5b3581b8-4326-4984-85f6-4e17402b262f tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:31.200331 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-5b3581b8-4326-4984-85f6-4e17402b262f tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:31.201551 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-5b3581b8-4326-4984-85f6-4e17402b262f tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a" status: 200 len: 1805 microversion: 2.20 time: 0.234484 Oct 28 09:49:31.219207 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 245/498] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:49:30 2022] GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a => generated 1805 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:49:31.810851 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-9384c492-52e1-4010-a532-e07050d4c97e tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:49:31.812459 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-9384c492-52e1-4010-a532-e07050d4c97e tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] [instance: 59cbacea-5702-4207-a63b-6ebc3f652dac] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:49:31.833470 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-9384c492-52e1-4010-a532-e07050d4c97e tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:31.833978 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-9384c492-52e1-4010-a532-e07050d4c97e tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:31.834421 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-9384c492-52e1-4010-a532-e07050d4c97e tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:31.835147 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-9384c492-52e1-4010-a532-e07050d4c97e tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:31.835607 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-9384c492-52e1-4010-a532-e07050d4c97e tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:31.836065 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-9384c492-52e1-4010-a532-e07050d4c97e tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:31.865845 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG dbcounter [-] [127032] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=127032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:49:32.002859 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-9384c492-52e1-4010-a532-e07050d4c97e tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36846c3821c14284893e25dd143d11e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1d6189cfd4437a13a0908119c7ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:32.011672 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-9384c492-52e1-4010-a532-e07050d4c97e tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] 10.222.0.52 "GET /compute/v2.1/servers/59cbacea-5702-4207-a63b-6ebc3f652dac" status: 200 len: 1318 microversion: 2.1 time: 0.205481 Oct 28 09:49:32.012317 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 254/499] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:49:31 2022] GET /compute/v2.1/servers/59cbacea-5702-4207-a63b-6ebc3f652dac => generated 1318 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:49:32.230500 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-7b202b07-5ff1-4efd-a45c-19a64ed27177 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:49:32.231119 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-7b202b07-5ff1-4efd-a45c-19a64ed27177 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 6869ffb6-ce4f-4a91-b8d9-7765ea56e95a] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:49:32.238072 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-7b202b07-5ff1-4efd-a45c-19a64ed27177 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:32.238556 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-7b202b07-5ff1-4efd-a45c-19a64ed27177 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:32.238983 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-7b202b07-5ff1-4efd-a45c-19a64ed27177 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:32.239894 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-7b202b07-5ff1-4efd-a45c-19a64ed27177 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:32.240353 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-7b202b07-5ff1-4efd-a45c-19a64ed27177 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:32.240770 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-7b202b07-5ff1-4efd-a45c-19a64ed27177 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:32.376201 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-7b202b07-5ff1-4efd-a45c-19a64ed27177 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:32.387110 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-7b202b07-5ff1-4efd-a45c-19a64ed27177 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:32.388570 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-7b202b07-5ff1-4efd-a45c-19a64ed27177 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:32.389841 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-7b202b07-5ff1-4efd-a45c-19a64ed27177 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a" status: 200 len: 1805 microversion: 2.20 time: 0.163255 Oct 28 09:49:32.390403 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 246/500] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:49:32 2022] GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a => generated 1805 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:49:33.037260 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-7d11c37a-30d1-4173-8927-8b1c7edac44e tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:49:33.037885 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-7d11c37a-30d1-4173-8927-8b1c7edac44e tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] [instance: 59cbacea-5702-4207-a63b-6ebc3f652dac] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:49:33.045199 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-7d11c37a-30d1-4173-8927-8b1c7edac44e tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:33.045700 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-7d11c37a-30d1-4173-8927-8b1c7edac44e tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:33.046225 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-7d11c37a-30d1-4173-8927-8b1c7edac44e tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:33.046900 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-7d11c37a-30d1-4173-8927-8b1c7edac44e tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:33.047356 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-7d11c37a-30d1-4173-8927-8b1c7edac44e tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:33.047818 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-7d11c37a-30d1-4173-8927-8b1c7edac44e tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:33.207120 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-7d11c37a-30d1-4173-8927-8b1c7edac44e tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36846c3821c14284893e25dd143d11e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1d6189cfd4437a13a0908119c7ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:33.217997 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-7d11c37a-30d1-4173-8927-8b1c7edac44e tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] 10.222.0.52 "GET /compute/v2.1/servers/59cbacea-5702-4207-a63b-6ebc3f652dac" status: 200 len: 1318 microversion: 2.1 time: 0.184213 Oct 28 09:49:33.219839 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 255/501] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:49:33 2022] GET /compute/v2.1/servers/59cbacea-5702-4207-a63b-6ebc3f652dac => generated 1318 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:49:33.416840 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-81eecb58-565e-4d82-b06f-d3bad8aacc3a tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:49:33.417398 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-81eecb58-565e-4d82-b06f-d3bad8aacc3a tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 6869ffb6-ce4f-4a91-b8d9-7765ea56e95a] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:49:33.424570 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-81eecb58-565e-4d82-b06f-d3bad8aacc3a tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:33.425128 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-81eecb58-565e-4d82-b06f-d3bad8aacc3a tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:33.425494 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-81eecb58-565e-4d82-b06f-d3bad8aacc3a tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:33.426176 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-81eecb58-565e-4d82-b06f-d3bad8aacc3a tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:33.426691 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-81eecb58-565e-4d82-b06f-d3bad8aacc3a tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:33.427042 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-81eecb58-565e-4d82-b06f-d3bad8aacc3a tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:33.582720 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-81eecb58-565e-4d82-b06f-d3bad8aacc3a tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:33.593780 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-81eecb58-565e-4d82-b06f-d3bad8aacc3a tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:33.595364 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-81eecb58-565e-4d82-b06f-d3bad8aacc3a tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:33.596642 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-81eecb58-565e-4d82-b06f-d3bad8aacc3a tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a" status: 200 len: 1805 microversion: 2.20 time: 0.184313 Oct 28 09:49:33.597689 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 247/502] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:49:33 2022] GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a => generated 1805 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:49:34.242276 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-0fb1a931-a6c6-4e4d-bb89-39293c9be349 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:49:34.243105 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-0fb1a931-a6c6-4e4d-bb89-39293c9be349 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] [instance: 59cbacea-5702-4207-a63b-6ebc3f652dac] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:49:34.249960 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-0fb1a931-a6c6-4e4d-bb89-39293c9be349 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:34.251107 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-0fb1a931-a6c6-4e4d-bb89-39293c9be349 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:34.251107 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-0fb1a931-a6c6-4e4d-bb89-39293c9be349 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:34.251570 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-0fb1a931-a6c6-4e4d-bb89-39293c9be349 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:34.252058 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-0fb1a931-a6c6-4e4d-bb89-39293c9be349 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:34.252481 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-0fb1a931-a6c6-4e4d-bb89-39293c9be349 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:34.387311 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-0fb1a931-a6c6-4e4d-bb89-39293c9be349 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36846c3821c14284893e25dd143d11e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1d6189cfd4437a13a0908119c7ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:34.396697 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-0fb1a931-a6c6-4e4d-bb89-39293c9be349 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] 10.222.0.52 "GET /compute/v2.1/servers/59cbacea-5702-4207-a63b-6ebc3f652dac" status: 200 len: 1318 microversion: 2.1 time: 0.158248 Oct 28 09:49:34.397280 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 256/503] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:49:34 2022] GET /compute/v2.1/servers/59cbacea-5702-4207-a63b-6ebc3f652dac => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:49:34.625991 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-d0f6452a-1870-4601-83d2-e63372d45ca5 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:49:34.627683 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-d0f6452a-1870-4601-83d2-e63372d45ca5 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 6869ffb6-ce4f-4a91-b8d9-7765ea56e95a] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:49:34.635635 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-d0f6452a-1870-4601-83d2-e63372d45ca5 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:34.636101 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-d0f6452a-1870-4601-83d2-e63372d45ca5 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:34.636541 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-d0f6452a-1870-4601-83d2-e63372d45ca5 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:34.637248 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-d0f6452a-1870-4601-83d2-e63372d45ca5 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:34.637705 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-d0f6452a-1870-4601-83d2-e63372d45ca5 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:34.638801 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-d0f6452a-1870-4601-83d2-e63372d45ca5 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:34.780484 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-d0f6452a-1870-4601-83d2-e63372d45ca5 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:34.789319 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-d0f6452a-1870-4601-83d2-e63372d45ca5 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:34.790844 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-d0f6452a-1870-4601-83d2-e63372d45ca5 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:34.792026 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-d0f6452a-1870-4601-83d2-e63372d45ca5 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a" status: 200 len: 1805 microversion: 2.20 time: 0.171209 Oct 28 09:49:34.792588 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 248/504] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:49:34 2022] GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a => generated 1805 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:49:35.420965 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-06fdc176-f11f-4b11-ac87-af7268cc534e tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:49:35.422543 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-06fdc176-f11f-4b11-ac87-af7268cc534e tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] [instance: 59cbacea-5702-4207-a63b-6ebc3f652dac] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:49:35.429257 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-06fdc176-f11f-4b11-ac87-af7268cc534e tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:35.430053 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-06fdc176-f11f-4b11-ac87-af7268cc534e tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:35.430837 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-06fdc176-f11f-4b11-ac87-af7268cc534e tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:35.431855 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-06fdc176-f11f-4b11-ac87-af7268cc534e tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:35.432723 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-06fdc176-f11f-4b11-ac87-af7268cc534e tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:35.433149 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-06fdc176-f11f-4b11-ac87-af7268cc534e tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:35.600304 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-06fdc176-f11f-4b11-ac87-af7268cc534e tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36846c3821c14284893e25dd143d11e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1d6189cfd4437a13a0908119c7ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:35.609305 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-06fdc176-f11f-4b11-ac87-af7268cc534e tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] 10.222.0.52 "GET /compute/v2.1/servers/59cbacea-5702-4207-a63b-6ebc3f652dac" status: 200 len: 1318 microversion: 2.1 time: 0.192126 Oct 28 09:49:35.610375 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 257/505] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:49:35 2022] GET /compute/v2.1/servers/59cbacea-5702-4207-a63b-6ebc3f652dac => generated 1318 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:49:35.820488 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-5a77c4ab-4ee3-4791-89af-209d8606a306 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:49:35.823945 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-5a77c4ab-4ee3-4791-89af-209d8606a306 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 6869ffb6-ce4f-4a91-b8d9-7765ea56e95a] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:49:35.830342 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-5a77c4ab-4ee3-4791-89af-209d8606a306 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:35.830919 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-5a77c4ab-4ee3-4791-89af-209d8606a306 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:35.831423 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-5a77c4ab-4ee3-4791-89af-209d8606a306 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:35.832308 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-5a77c4ab-4ee3-4791-89af-209d8606a306 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:35.832911 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-5a77c4ab-4ee3-4791-89af-209d8606a306 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:35.833626 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-5a77c4ab-4ee3-4791-89af-209d8606a306 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:35.987008 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-5a77c4ab-4ee3-4791-89af-209d8606a306 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:35.996086 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-5a77c4ab-4ee3-4791-89af-209d8606a306 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:35.997643 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-5a77c4ab-4ee3-4791-89af-209d8606a306 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:35.998922 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-5a77c4ab-4ee3-4791-89af-209d8606a306 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a" status: 200 len: 1805 microversion: 2.20 time: 0.183346 Oct 28 09:49:35.999509 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 249/506] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:49:35 2022] GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a => generated 1805 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:49:36.633238 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-de2b7f3e-0e3c-45e0-972d-1cf881a40cfc tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:49:36.633853 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-de2b7f3e-0e3c-45e0-972d-1cf881a40cfc tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] [instance: 59cbacea-5702-4207-a63b-6ebc3f652dac] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:49:36.640236 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-de2b7f3e-0e3c-45e0-972d-1cf881a40cfc tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:36.640714 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-de2b7f3e-0e3c-45e0-972d-1cf881a40cfc tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:36.641147 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-de2b7f3e-0e3c-45e0-972d-1cf881a40cfc tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:36.641842 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-de2b7f3e-0e3c-45e0-972d-1cf881a40cfc tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:36.642294 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-de2b7f3e-0e3c-45e0-972d-1cf881a40cfc tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:36.642713 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-de2b7f3e-0e3c-45e0-972d-1cf881a40cfc tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:36.786638 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-de2b7f3e-0e3c-45e0-972d-1cf881a40cfc tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36846c3821c14284893e25dd143d11e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1d6189cfd4437a13a0908119c7ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:36.794924 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-de2b7f3e-0e3c-45e0-972d-1cf881a40cfc tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] 10.222.0.52 "GET /compute/v2.1/servers/59cbacea-5702-4207-a63b-6ebc3f652dac" status: 200 len: 1318 microversion: 2.1 time: 0.166050 Oct 28 09:49:36.795424 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 258/507] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:49:36 2022] GET /compute/v2.1/servers/59cbacea-5702-4207-a63b-6ebc3f652dac => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:49:37.025890 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-019185e6-d29b-45ed-9738-64d7d4bdfd57 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:49:37.026597 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-019185e6-d29b-45ed-9738-64d7d4bdfd57 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 6869ffb6-ce4f-4a91-b8d9-7765ea56e95a] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:49:37.033124 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-019185e6-d29b-45ed-9738-64d7d4bdfd57 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:37.033743 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-019185e6-d29b-45ed-9738-64d7d4bdfd57 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:37.034237 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-019185e6-d29b-45ed-9738-64d7d4bdfd57 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:37.035004 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-019185e6-d29b-45ed-9738-64d7d4bdfd57 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:37.035455 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-019185e6-d29b-45ed-9738-64d7d4bdfd57 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:37.035908 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-019185e6-d29b-45ed-9738-64d7d4bdfd57 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:37.176537 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-019185e6-d29b-45ed-9738-64d7d4bdfd57 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:37.185925 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-019185e6-d29b-45ed-9738-64d7d4bdfd57 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:37.187790 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-019185e6-d29b-45ed-9738-64d7d4bdfd57 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:37.189924 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-019185e6-d29b-45ed-9738-64d7d4bdfd57 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a" status: 200 len: 1805 microversion: 2.20 time: 0.167670 Oct 28 09:49:37.190534 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 250/508] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:49:37 2022] GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a => generated 1805 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:49:37.817782 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-7ec67101-6565-4514-b50e-01ca5a4b1e97 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:49:37.818330 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-7ec67101-6565-4514-b50e-01ca5a4b1e97 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] [instance: 59cbacea-5702-4207-a63b-6ebc3f652dac] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:49:37.825625 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-7ec67101-6565-4514-b50e-01ca5a4b1e97 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:37.826104 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-7ec67101-6565-4514-b50e-01ca5a4b1e97 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:37.826533 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-7ec67101-6565-4514-b50e-01ca5a4b1e97 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:37.827221 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-7ec67101-6565-4514-b50e-01ca5a4b1e97 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:37.827670 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-7ec67101-6565-4514-b50e-01ca5a4b1e97 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:37.828114 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-7ec67101-6565-4514-b50e-01ca5a4b1e97 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:37.961714 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-7ec67101-6565-4514-b50e-01ca5a4b1e97 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36846c3821c14284893e25dd143d11e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1d6189cfd4437a13a0908119c7ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:37.969437 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-7ec67101-6565-4514-b50e-01ca5a4b1e97 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] 10.222.0.52 "GET /compute/v2.1/servers/59cbacea-5702-4207-a63b-6ebc3f652dac" status: 200 len: 1318 microversion: 2.1 time: 0.155543 Oct 28 09:49:37.970018 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 259/509] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:49:37 2022] GET /compute/v2.1/servers/59cbacea-5702-4207-a63b-6ebc3f652dac => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:49:38.217134 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-cc5d34c7-d364-464c-a93e-085d4ac359d6 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:49:38.217733 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-cc5d34c7-d364-464c-a93e-085d4ac359d6 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 6869ffb6-ce4f-4a91-b8d9-7765ea56e95a] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:49:38.224090 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-cc5d34c7-d364-464c-a93e-085d4ac359d6 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:38.224577 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-cc5d34c7-d364-464c-a93e-085d4ac359d6 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:38.225007 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-cc5d34c7-d364-464c-a93e-085d4ac359d6 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:38.225695 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-cc5d34c7-d364-464c-a93e-085d4ac359d6 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:38.226142 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-cc5d34c7-d364-464c-a93e-085d4ac359d6 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:38.226565 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-cc5d34c7-d364-464c-a93e-085d4ac359d6 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:38.352487 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-cc5d34c7-d364-464c-a93e-085d4ac359d6 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:38.362077 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-cc5d34c7-d364-464c-a93e-085d4ac359d6 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:38.363512 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-cc5d34c7-d364-464c-a93e-085d4ac359d6 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:38.364817 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-cc5d34c7-d364-464c-a93e-085d4ac359d6 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a" status: 200 len: 1805 microversion: 2.20 time: 0.152038 Oct 28 09:49:38.365706 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 251/510] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:49:38 2022] GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a => generated 1805 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:49:38.993445 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-061c5630-a32b-405c-b660-24540323dcd4 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:49:38.994176 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-061c5630-a32b-405c-b660-24540323dcd4 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] [instance: 59cbacea-5702-4207-a63b-6ebc3f652dac] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:49:39.000357 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-061c5630-a32b-405c-b660-24540323dcd4 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:39.000838 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-061c5630-a32b-405c-b660-24540323dcd4 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:39.001274 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-061c5630-a32b-405c-b660-24540323dcd4 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:39.001957 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-061c5630-a32b-405c-b660-24540323dcd4 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:39.002408 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-061c5630-a32b-405c-b660-24540323dcd4 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:39.002826 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-061c5630-a32b-405c-b660-24540323dcd4 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:39.137075 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-061c5630-a32b-405c-b660-24540323dcd4 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36846c3821c14284893e25dd143d11e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1d6189cfd4437a13a0908119c7ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:39.144881 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-061c5630-a32b-405c-b660-24540323dcd4 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] 10.222.0.52 "GET /compute/v2.1/servers/59cbacea-5702-4207-a63b-6ebc3f652dac" status: 200 len: 1318 microversion: 2.1 time: 0.155267 Oct 28 09:49:39.145446 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 260/511] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:49:38 2022] GET /compute/v2.1/servers/59cbacea-5702-4207-a63b-6ebc3f652dac => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:49:39.390314 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-5516be0d-a776-420c-a427-01ff6e96a0ad tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:49:39.390854 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-5516be0d-a776-420c-a427-01ff6e96a0ad tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 6869ffb6-ce4f-4a91-b8d9-7765ea56e95a] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:49:39.397184 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-5516be0d-a776-420c-a427-01ff6e96a0ad tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:39.397654 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-5516be0d-a776-420c-a427-01ff6e96a0ad tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:39.398091 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-5516be0d-a776-420c-a427-01ff6e96a0ad tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:39.398774 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-5516be0d-a776-420c-a427-01ff6e96a0ad tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:39.399228 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-5516be0d-a776-420c-a427-01ff6e96a0ad tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:39.399652 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-5516be0d-a776-420c-a427-01ff6e96a0ad tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:39.526170 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-5516be0d-a776-420c-a427-01ff6e96a0ad tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:39.536289 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-5516be0d-a776-420c-a427-01ff6e96a0ad tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:39.537733 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-5516be0d-a776-420c-a427-01ff6e96a0ad tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:39.538891 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-5516be0d-a776-420c-a427-01ff6e96a0ad tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a" status: 200 len: 1805 microversion: 2.20 time: 0.153712 Oct 28 09:49:39.539444 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 252/512] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:49:39 2022] GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a => generated 1805 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:49:40.169113 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-616290b3-d00d-4456-b88f-43584b3e95a8 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:49:40.169717 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-616290b3-d00d-4456-b88f-43584b3e95a8 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] [instance: 59cbacea-5702-4207-a63b-6ebc3f652dac] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:49:40.176078 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-616290b3-d00d-4456-b88f-43584b3e95a8 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:40.176561 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-616290b3-d00d-4456-b88f-43584b3e95a8 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:40.176999 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-616290b3-d00d-4456-b88f-43584b3e95a8 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:40.177682 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-616290b3-d00d-4456-b88f-43584b3e95a8 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:40.178130 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-616290b3-d00d-4456-b88f-43584b3e95a8 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:40.178549 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-616290b3-d00d-4456-b88f-43584b3e95a8 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:40.304558 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-616290b3-d00d-4456-b88f-43584b3e95a8 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36846c3821c14284893e25dd143d11e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1d6189cfd4437a13a0908119c7ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:40.312837 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-616290b3-d00d-4456-b88f-43584b3e95a8 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] 10.222.0.52 "GET /compute/v2.1/servers/59cbacea-5702-4207-a63b-6ebc3f652dac" status: 200 len: 1318 microversion: 2.1 time: 0.148192 Oct 28 09:49:40.313402 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 261/513] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:49:40 2022] GET /compute/v2.1/servers/59cbacea-5702-4207-a63b-6ebc3f652dac => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:49:40.564954 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-f15cbed8-2212-4389-a1dc-8d4844c51916 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:49:40.565542 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-f15cbed8-2212-4389-a1dc-8d4844c51916 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 6869ffb6-ce4f-4a91-b8d9-7765ea56e95a] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:49:40.571994 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-f15cbed8-2212-4389-a1dc-8d4844c51916 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:40.572487 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-f15cbed8-2212-4389-a1dc-8d4844c51916 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:40.572923 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-f15cbed8-2212-4389-a1dc-8d4844c51916 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:40.574216 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-f15cbed8-2212-4389-a1dc-8d4844c51916 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:40.574672 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-f15cbed8-2212-4389-a1dc-8d4844c51916 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:40.575096 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-f15cbed8-2212-4389-a1dc-8d4844c51916 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:40.592412 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG dbcounter [-] [127033] Writing DB stats nova_cell1:SELECT=100 {{(pid=127033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:49:40.705732 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-f15cbed8-2212-4389-a1dc-8d4844c51916 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:40.714317 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-f15cbed8-2212-4389-a1dc-8d4844c51916 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:40.715883 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-f15cbed8-2212-4389-a1dc-8d4844c51916 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:40.717049 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-f15cbed8-2212-4389-a1dc-8d4844c51916 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a" status: 200 len: 1805 microversion: 2.20 time: 0.156057 Oct 28 09:49:40.717611 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 253/514] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:49:40 2022] GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a => generated 1805 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:49:41.336241 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-0dd59017-a720-4c46-9bf4-b32aa28447d8 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:49:41.336964 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-0dd59017-a720-4c46-9bf4-b32aa28447d8 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] [instance: 59cbacea-5702-4207-a63b-6ebc3f652dac] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:49:41.348411 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-0dd59017-a720-4c46-9bf4-b32aa28447d8 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:41.348911 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-0dd59017-a720-4c46-9bf4-b32aa28447d8 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:41.349348 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-0dd59017-a720-4c46-9bf4-b32aa28447d8 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:41.350067 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-0dd59017-a720-4c46-9bf4-b32aa28447d8 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:41.350522 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-0dd59017-a720-4c46-9bf4-b32aa28447d8 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:41.350948 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-0dd59017-a720-4c46-9bf4-b32aa28447d8 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:41.490964 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-0dd59017-a720-4c46-9bf4-b32aa28447d8 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36846c3821c14284893e25dd143d11e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1d6189cfd4437a13a0908119c7ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:41.498657 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-0dd59017-a720-4c46-9bf4-b32aa28447d8 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] 10.222.0.52 "GET /compute/v2.1/servers/59cbacea-5702-4207-a63b-6ebc3f652dac" status: 200 len: 1318 microversion: 2.1 time: 0.166250 Oct 28 09:49:41.499230 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 262/515] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:49:41 2022] GET /compute/v2.1/servers/59cbacea-5702-4207-a63b-6ebc3f652dac => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:49:41.742667 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-fec6e2e8-cfd7-40a6-bbef-d5f3d730b68c tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:49:41.743200 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-fec6e2e8-cfd7-40a6-bbef-d5f3d730b68c tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 6869ffb6-ce4f-4a91-b8d9-7765ea56e95a] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:49:41.749599 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-fec6e2e8-cfd7-40a6-bbef-d5f3d730b68c tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:41.750085 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-fec6e2e8-cfd7-40a6-bbef-d5f3d730b68c tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:41.750523 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-fec6e2e8-cfd7-40a6-bbef-d5f3d730b68c tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:41.751210 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-fec6e2e8-cfd7-40a6-bbef-d5f3d730b68c tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:41.751666 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-fec6e2e8-cfd7-40a6-bbef-d5f3d730b68c tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:41.752188 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-fec6e2e8-cfd7-40a6-bbef-d5f3d730b68c tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:42.060196 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-fec6e2e8-cfd7-40a6-bbef-d5f3d730b68c tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:42.069128 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-fec6e2e8-cfd7-40a6-bbef-d5f3d730b68c tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:42.070569 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-fec6e2e8-cfd7-40a6-bbef-d5f3d730b68c tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:42.071716 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-fec6e2e8-cfd7-40a6-bbef-d5f3d730b68c tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a" status: 200 len: 1805 microversion: 2.20 time: 0.333133 Oct 28 09:49:42.072393 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 254/516] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:49:41 2022] GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a => generated 1805 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:49:42.522459 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-525a9d45-c963-4e32-9baf-0d5b926948b3 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:49:42.523099 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-525a9d45-c963-4e32-9baf-0d5b926948b3 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] [instance: 59cbacea-5702-4207-a63b-6ebc3f652dac] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:49:42.530359 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-525a9d45-c963-4e32-9baf-0d5b926948b3 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:42.530840 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-525a9d45-c963-4e32-9baf-0d5b926948b3 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:42.531273 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-525a9d45-c963-4e32-9baf-0d5b926948b3 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:42.532000 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-525a9d45-c963-4e32-9baf-0d5b926948b3 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:42.532457 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-525a9d45-c963-4e32-9baf-0d5b926948b3 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:42.532878 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-525a9d45-c963-4e32-9baf-0d5b926948b3 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:42.661581 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-525a9d45-c963-4e32-9baf-0d5b926948b3 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36846c3821c14284893e25dd143d11e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1d6189cfd4437a13a0908119c7ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:42.674346 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-525a9d45-c963-4e32-9baf-0d5b926948b3 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] 10.222.0.52 "GET /compute/v2.1/servers/59cbacea-5702-4207-a63b-6ebc3f652dac" status: 200 len: 1318 microversion: 2.1 time: 0.155785 Oct 28 09:49:42.674925 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 263/517] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:49:42 2022] GET /compute/v2.1/servers/59cbacea-5702-4207-a63b-6ebc3f652dac => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:49:43.096916 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-716bd661-ad78-4bd0-86c7-657681add62f tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:49:43.097520 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-716bd661-ad78-4bd0-86c7-657681add62f tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 6869ffb6-ce4f-4a91-b8d9-7765ea56e95a] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:49:43.103986 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-716bd661-ad78-4bd0-86c7-657681add62f tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:43.104473 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-716bd661-ad78-4bd0-86c7-657681add62f tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:43.104909 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-716bd661-ad78-4bd0-86c7-657681add62f tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:43.105596 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-716bd661-ad78-4bd0-86c7-657681add62f tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:43.106051 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-716bd661-ad78-4bd0-86c7-657681add62f tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:43.106506 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-716bd661-ad78-4bd0-86c7-657681add62f tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:43.236117 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-716bd661-ad78-4bd0-86c7-657681add62f tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:43.244720 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-716bd661-ad78-4bd0-86c7-657681add62f tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:43.246211 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-716bd661-ad78-4bd0-86c7-657681add62f tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:43.247372 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-716bd661-ad78-4bd0-86c7-657681add62f tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a" status: 200 len: 1805 microversion: 2.20 time: 0.154551 Oct 28 09:49:43.247959 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 255/518] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:49:43 2022] GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a => generated 1805 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:49:43.697949 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-d80e5d99-59c9-420a-8206-1259fa18a935 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:49:43.698576 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-d80e5d99-59c9-420a-8206-1259fa18a935 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] [instance: 59cbacea-5702-4207-a63b-6ebc3f652dac] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:49:43.704953 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-d80e5d99-59c9-420a-8206-1259fa18a935 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:43.705429 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-d80e5d99-59c9-420a-8206-1259fa18a935 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:43.705867 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-d80e5d99-59c9-420a-8206-1259fa18a935 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:43.706555 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-d80e5d99-59c9-420a-8206-1259fa18a935 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:43.707034 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-d80e5d99-59c9-420a-8206-1259fa18a935 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:43.707457 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-d80e5d99-59c9-420a-8206-1259fa18a935 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:43.834569 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-d80e5d99-59c9-420a-8206-1259fa18a935 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36846c3821c14284893e25dd143d11e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1d6189cfd4437a13a0908119c7ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:43.842143 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-d80e5d99-59c9-420a-8206-1259fa18a935 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] 10.222.0.52 "GET /compute/v2.1/servers/59cbacea-5702-4207-a63b-6ebc3f652dac" status: 200 len: 1318 microversion: 2.1 time: 0.148105 Oct 28 09:49:43.842718 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 264/519] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:49:43 2022] GET /compute/v2.1/servers/59cbacea-5702-4207-a63b-6ebc3f652dac => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:49:44.273228 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-38efa648-2af5-4967-b53b-d88d78e5bbb9 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:49:44.273832 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-38efa648-2af5-4967-b53b-d88d78e5bbb9 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 6869ffb6-ce4f-4a91-b8d9-7765ea56e95a] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:49:44.280805 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-38efa648-2af5-4967-b53b-d88d78e5bbb9 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:44.281287 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-38efa648-2af5-4967-b53b-d88d78e5bbb9 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:44.281719 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-38efa648-2af5-4967-b53b-d88d78e5bbb9 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:44.282405 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-38efa648-2af5-4967-b53b-d88d78e5bbb9 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:44.282859 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-38efa648-2af5-4967-b53b-d88d78e5bbb9 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:44.283280 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-38efa648-2af5-4967-b53b-d88d78e5bbb9 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:44.411272 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-38efa648-2af5-4967-b53b-d88d78e5bbb9 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:44.419733 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-38efa648-2af5-4967-b53b-d88d78e5bbb9 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:44.421179 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-38efa648-2af5-4967-b53b-d88d78e5bbb9 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:44.422321 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-38efa648-2af5-4967-b53b-d88d78e5bbb9 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a" status: 200 len: 1805 microversion: 2.20 time: 0.153027 Oct 28 09:49:44.422872 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 256/520] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:49:44 2022] GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a => generated 1805 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:49:44.865831 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-3af3436d-d200-4660-8a88-683f84b9bf7b tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:49:44.866428 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-3af3436d-d200-4660-8a88-683f84b9bf7b tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] [instance: 59cbacea-5702-4207-a63b-6ebc3f652dac] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:49:44.873456 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-3af3436d-d200-4660-8a88-683f84b9bf7b tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:44.873940 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-3af3436d-d200-4660-8a88-683f84b9bf7b tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:44.874374 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-3af3436d-d200-4660-8a88-683f84b9bf7b tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:44.875073 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-3af3436d-d200-4660-8a88-683f84b9bf7b tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:44.875523 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-3af3436d-d200-4660-8a88-683f84b9bf7b tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:44.875999 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-3af3436d-d200-4660-8a88-683f84b9bf7b tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:45.025299 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-3af3436d-d200-4660-8a88-683f84b9bf7b tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36846c3821c14284893e25dd143d11e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1d6189cfd4437a13a0908119c7ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:45.033582 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-3af3436d-d200-4660-8a88-683f84b9bf7b tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] 10.222.0.52 "GET /compute/v2.1/servers/59cbacea-5702-4207-a63b-6ebc3f652dac" status: 200 len: 1318 microversion: 2.1 time: 0.171694 Oct 28 09:49:45.034255 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 265/521] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:49:44 2022] GET /compute/v2.1/servers/59cbacea-5702-4207-a63b-6ebc3f652dac => generated 1318 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:49:45.448043 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-535dcc30-f0a0-4463-8198-a84ad723c7c9 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:49:45.448787 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-535dcc30-f0a0-4463-8198-a84ad723c7c9 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 6869ffb6-ce4f-4a91-b8d9-7765ea56e95a] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:49:45.455736 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-535dcc30-f0a0-4463-8198-a84ad723c7c9 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:45.456261 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-535dcc30-f0a0-4463-8198-a84ad723c7c9 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:45.456704 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-535dcc30-f0a0-4463-8198-a84ad723c7c9 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:45.457408 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-535dcc30-f0a0-4463-8198-a84ad723c7c9 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:45.457869 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-535dcc30-f0a0-4463-8198-a84ad723c7c9 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:45.458298 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-535dcc30-f0a0-4463-8198-a84ad723c7c9 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:45.600111 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-535dcc30-f0a0-4463-8198-a84ad723c7c9 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:45.616221 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-535dcc30-f0a0-4463-8198-a84ad723c7c9 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:45.617665 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-535dcc30-f0a0-4463-8198-a84ad723c7c9 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:45.618842 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-535dcc30-f0a0-4463-8198-a84ad723c7c9 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a" status: 200 len: 1805 microversion: 2.20 time: 0.175104 Oct 28 09:49:45.619405 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 257/522] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:49:45 2022] GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a => generated 1805 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:49:46.058463 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-c870e6a8-3819-4286-ac1d-737f84f47be8 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:49:46.059226 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-c870e6a8-3819-4286-ac1d-737f84f47be8 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] [instance: 59cbacea-5702-4207-a63b-6ebc3f652dac] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:49:46.061662 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG dbcounter [-] [127032] Writing DB stats nova_api:SELECT=56 {{(pid=127032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:49:46.067297 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-c870e6a8-3819-4286-ac1d-737f84f47be8 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:46.067818 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-c870e6a8-3819-4286-ac1d-737f84f47be8 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:46.068403 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-c870e6a8-3819-4286-ac1d-737f84f47be8 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:46.069129 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-c870e6a8-3819-4286-ac1d-737f84f47be8 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:46.069590 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-c870e6a8-3819-4286-ac1d-737f84f47be8 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:46.070018 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-c870e6a8-3819-4286-ac1d-737f84f47be8 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:46.208061 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-c870e6a8-3819-4286-ac1d-737f84f47be8 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36846c3821c14284893e25dd143d11e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1d6189cfd4437a13a0908119c7ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:46.216600 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-c870e6a8-3819-4286-ac1d-737f84f47be8 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] 10.222.0.52 "GET /compute/v2.1/servers/59cbacea-5702-4207-a63b-6ebc3f652dac" status: 200 len: 1318 microversion: 2.1 time: 0.162418 Oct 28 09:49:46.217178 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 266/523] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:49:46 2022] GET /compute/v2.1/servers/59cbacea-5702-4207-a63b-6ebc3f652dac => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:49:46.648006 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-b915bef7-84aa-4144-97b6-87ac200fbfc2 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:49:46.648942 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-b915bef7-84aa-4144-97b6-87ac200fbfc2 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 6869ffb6-ce4f-4a91-b8d9-7765ea56e95a] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:49:46.651420 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG dbcounter [-] [127033] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:49:46.657219 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-b915bef7-84aa-4144-97b6-87ac200fbfc2 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:46.657712 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-b915bef7-84aa-4144-97b6-87ac200fbfc2 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:46.658159 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-b915bef7-84aa-4144-97b6-87ac200fbfc2 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:46.658880 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-b915bef7-84aa-4144-97b6-87ac200fbfc2 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:46.659337 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-b915bef7-84aa-4144-97b6-87ac200fbfc2 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:46.659798 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-b915bef7-84aa-4144-97b6-87ac200fbfc2 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:46.799179 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-b915bef7-84aa-4144-97b6-87ac200fbfc2 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:46.809027 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-b915bef7-84aa-4144-97b6-87ac200fbfc2 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:46.810522 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-b915bef7-84aa-4144-97b6-87ac200fbfc2 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:46.811728 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-b915bef7-84aa-4144-97b6-87ac200fbfc2 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a" status: 200 len: 1805 microversion: 2.20 time: 0.171501 Oct 28 09:49:46.812321 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 258/524] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:49:46 2022] GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a => generated 1805 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:49:47.240563 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-3f81f068-a25e-4e5e-b174-eae9d6e2dc5f tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:49:47.241920 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-3f81f068-a25e-4e5e-b174-eae9d6e2dc5f tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] [instance: 59cbacea-5702-4207-a63b-6ebc3f652dac] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:49:47.249381 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-3f81f068-a25e-4e5e-b174-eae9d6e2dc5f tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:47.250392 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-3f81f068-a25e-4e5e-b174-eae9d6e2dc5f tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:47.250916 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-3f81f068-a25e-4e5e-b174-eae9d6e2dc5f tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:47.251707 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-3f81f068-a25e-4e5e-b174-eae9d6e2dc5f tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:47.252194 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-3f81f068-a25e-4e5e-b174-eae9d6e2dc5f tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:47.252622 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-3f81f068-a25e-4e5e-b174-eae9d6e2dc5f tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:47.397744 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [req-53671477-1a6e-4010-bc94-c39e40a4f93b req-7be39b59-081c-454d-97a0-a53851f60e5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6869ffb6-ce4f-4a91-b8d9-7765ea56e95a", "name": "network-vif-plugged", "status": "completed", "tag": "f350d1f8-ff54-4a77-b413-0023d0d49856"}]} {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:49:47.406230 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-3f81f068-a25e-4e5e-b174-eae9d6e2dc5f tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36846c3821c14284893e25dd143d11e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1d6189cfd4437a13a0908119c7ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:47.412734 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-53671477-1a6e-4010-bc94-c39e40a4f93b req-7be39b59-081c-454d-97a0-a53851f60e5d service nova] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:47.413227 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-53671477-1a6e-4010-bc94-c39e40a4f93b req-7be39b59-081c-454d-97a0-a53851f60e5d service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:47.413661 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-53671477-1a6e-4010-bc94-c39e40a4f93b req-7be39b59-081c-454d-97a0-a53851f60e5d service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:47.418202 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-3f81f068-a25e-4e5e-b174-eae9d6e2dc5f tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] 10.222.0.52 "GET /compute/v2.1/servers/59cbacea-5702-4207-a63b-6ebc3f652dac" status: 200 len: 1506 microversion: 2.1 time: 0.181615 Oct 28 09:49:47.418793 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 267/525] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:49:47 2022] GET /compute/v2.1/servers/59cbacea-5702-4207-a63b-6ebc3f652dac => generated 1506 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:49:47.440146 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-019f653c-da6f-4768-a25a-91a837fe9108 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0b8e6b7a-1705-480c-9ad7-b8f7126ad09e", "device": "/dev/sdb"}} {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:49:47.440735 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.compute.server_external_events [req-53671477-1a6e-4010-bc94-c39e40a4f93b req-7be39b59-081c-454d-97a0-a53851f60e5d service nova] Creating event network-vif-plugged:f350d1f8-ff54-4a77-b413-0023d0d49856 for instance 6869ffb6-ce4f-4a91-b8d9-7765ea56e95a on hv-cinder-zed-3 Oct 28 09:49:47.443053 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-019f653c-da6f-4768-a25a-91a837fe9108 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] [instance: 59cbacea-5702-4207-a63b-6ebc3f652dac] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:49:47.446071 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [req-53671477-1a6e-4010-bc94-c39e40a4f93b req-7be39b59-081c-454d-97a0-a53851f60e5d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052967 Oct 28 09:49:47.446766 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 259/526] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Oct 28 09:49:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:49:47.450220 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-019f653c-da6f-4768-a25a-91a837fe9108 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:47.451107 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-019f653c-da6f-4768-a25a-91a837fe9108 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:47.451107 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-019f653c-da6f-4768-a25a-91a837fe9108 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:47.452024 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-019f653c-da6f-4768-a25a-91a837fe9108 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:47.452473 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-019f653c-da6f-4768-a25a-91a837fe9108 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:47.452764 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-019f653c-da6f-4768-a25a-91a837fe9108 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:47.838363 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-c12004bd-971b-4e79-9854-88d9829d2346 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:49:47.839085 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-c12004bd-971b-4e79-9854-88d9829d2346 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 6869ffb6-ce4f-4a91-b8d9-7765ea56e95a] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:49:47.845334 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-c12004bd-971b-4e79-9854-88d9829d2346 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:47.845818 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-c12004bd-971b-4e79-9854-88d9829d2346 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:47.846252 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-c12004bd-971b-4e79-9854-88d9829d2346 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:47.846977 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-c12004bd-971b-4e79-9854-88d9829d2346 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:47.847431 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-c12004bd-971b-4e79-9854-88d9829d2346 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:47.847884 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-c12004bd-971b-4e79-9854-88d9829d2346 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:47.987795 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-c12004bd-971b-4e79-9854-88d9829d2346 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:47.996970 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-c12004bd-971b-4e79-9854-88d9829d2346 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:47.998418 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-c12004bd-971b-4e79-9854-88d9829d2346 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:47.999588 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-c12004bd-971b-4e79-9854-88d9829d2346 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a" status: 200 len: 1805 microversion: 2.20 time: 0.166003 Oct 28 09:49:48.000189 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 260/527] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:49:47 2022] GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a => generated 1805 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:49:48.260715 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-019f653c-da6f-4768-a25a-91a837fe9108 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] 10.222.0.52 "POST /compute/v2.1/servers/59cbacea-5702-4207-a63b-6ebc3f652dac/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.824274 Oct 28 09:49:48.261440 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 268/528] 10.222.0.52 () {60 vars in 1323 bytes} [Fri Oct 28 09:49:47 2022] POST /compute/v2.1/servers/59cbacea-5702-4207-a63b-6ebc3f652dac/os-volume_attachments => generated 194 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 09:49:49.026578 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-a6bb3451-ee07-49ee-a4e2-dccc82ea2c44 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:49:49.027822 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-a6bb3451-ee07-49ee-a4e2-dccc82ea2c44 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 6869ffb6-ce4f-4a91-b8d9-7765ea56e95a] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:49:49.034158 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-a6bb3451-ee07-49ee-a4e2-dccc82ea2c44 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:49.034639 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-a6bb3451-ee07-49ee-a4e2-dccc82ea2c44 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:49.035077 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-a6bb3451-ee07-49ee-a4e2-dccc82ea2c44 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:49.035805 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-a6bb3451-ee07-49ee-a4e2-dccc82ea2c44 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:49.036257 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-a6bb3451-ee07-49ee-a4e2-dccc82ea2c44 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:49.036674 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-a6bb3451-ee07-49ee-a4e2-dccc82ea2c44 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:49.186726 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-a6bb3451-ee07-49ee-a4e2-dccc82ea2c44 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:49.195870 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-a6bb3451-ee07-49ee-a4e2-dccc82ea2c44 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:49.197405 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-a6bb3451-ee07-49ee-a4e2-dccc82ea2c44 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:49.198639 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-a6bb3451-ee07-49ee-a4e2-dccc82ea2c44 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a" status: 200 len: 1805 microversion: 2.20 time: 0.176062 Oct 28 09:49:49.199869 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 261/529] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:49:49 2022] GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a => generated 1805 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:49:50.226415 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-d680ee29-a3ac-47d8-8430-15c095361818 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:49:50.227132 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-d680ee29-a3ac-47d8-8430-15c095361818 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 6869ffb6-ce4f-4a91-b8d9-7765ea56e95a] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:49:50.238461 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-d680ee29-a3ac-47d8-8430-15c095361818 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:50.238967 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-d680ee29-a3ac-47d8-8430-15c095361818 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:50.239436 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-d680ee29-a3ac-47d8-8430-15c095361818 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:50.240197 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-d680ee29-a3ac-47d8-8430-15c095361818 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:50.240654 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-d680ee29-a3ac-47d8-8430-15c095361818 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:50.241078 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-d680ee29-a3ac-47d8-8430-15c095361818 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:50.390519 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-d680ee29-a3ac-47d8-8430-15c095361818 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:50.392862 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG dbcounter [-] [127032] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:49:50.400878 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-d680ee29-a3ac-47d8-8430-15c095361818 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:50.402988 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-d680ee29-a3ac-47d8-8430-15c095361818 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:50.404201 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-d680ee29-a3ac-47d8-8430-15c095361818 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a" status: 200 len: 1805 microversion: 2.20 time: 0.182953 Oct 28 09:49:50.405015 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 269/530] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:49:50 2022] GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a => generated 1805 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:49:51.429518 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-2c2c2cd1-a477-4972-a601-9a032e66c814 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:49:51.430170 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-2c2c2cd1-a477-4972-a601-9a032e66c814 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 6869ffb6-ce4f-4a91-b8d9-7765ea56e95a] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:49:51.437469 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-2c2c2cd1-a477-4972-a601-9a032e66c814 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:51.437950 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-2c2c2cd1-a477-4972-a601-9a032e66c814 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:51.438385 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-2c2c2cd1-a477-4972-a601-9a032e66c814 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:51.439070 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-2c2c2cd1-a477-4972-a601-9a032e66c814 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:51.439524 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-2c2c2cd1-a477-4972-a601-9a032e66c814 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:51.439982 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-2c2c2cd1-a477-4972-a601-9a032e66c814 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:51.572410 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-2c2c2cd1-a477-4972-a601-9a032e66c814 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:51.581326 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-2c2c2cd1-a477-4972-a601-9a032e66c814 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:51.582753 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-2c2c2cd1-a477-4972-a601-9a032e66c814 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:51.584775 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-2c2c2cd1-a477-4972-a601-9a032e66c814 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a" status: 200 len: 1792 microversion: 2.20 time: 0.158344 Oct 28 09:49:51.586220 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 262/531] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:49:51 2022] GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a => generated 1792 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:49:52.058430 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [req-68291ce2-be9e-4ffb-9364-861a337be166 req-7ac72cb8-a0a6-4960-aa3a-153c03b2d0f9 admin admin] Action: 'create', calling method: >, body: {"snapshot": {"volume_id": "0b8e6b7a-1705-480c-9ad7-b8f7126ad09e", "create_info": {"type": "qcow2", "new_file": "volume-0b8e6b7a-1705-480c-9ad7-b8f7126ad09e.217837e8-03a6-4ee3-b679-b0f6ff227207.vhdx", "snapshot_id": "217837e8-03a6-4ee3-b679-b0f6ff227207"}}} {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:49:52.061831 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-68291ce2-be9e-4ffb-9364-861a337be166 req-7ac72cb8-a0a6-4960-aa3a-153c03b2d0f9 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:52.062322 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-68291ce2-be9e-4ffb-9364-861a337be166 req-7ac72cb8-a0a6-4960-aa3a-153c03b2d0f9 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:52.062761 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-68291ce2-be9e-4ffb-9364-861a337be166 req-7ac72cb8-a0a6-4960-aa3a-153c03b2d0f9 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:52.072394 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-68291ce2-be9e-4ffb-9364-861a337be166 req-7ac72cb8-a0a6-4960-aa3a-153c03b2d0f9 admin admin] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:52.073240 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-68291ce2-be9e-4ffb-9364-861a337be166 req-7ac72cb8-a0a6-4960-aa3a-153c03b2d0f9 admin admin] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:52.074485 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-68291ce2-be9e-4ffb-9364-861a337be166 req-7ac72cb8-a0a6-4960-aa3a-153c03b2d0f9 admin admin] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:52.090871 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [req-68291ce2-be9e-4ffb-9364-861a337be166 req-7ac72cb8-a0a6-4960-aa3a-153c03b2d0f9 admin admin] 10.222.0.58 "POST /compute/v2.1/os-assisted-volume-snapshots" status: 200 len: 78 microversion: 2.1 time: 0.154379 Oct 28 09:49:52.091479 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 270/532] 10.222.0.58 () {64 vars in 1326 bytes} [Fri Oct 28 09:49:51 2022] POST /compute/v2.1/os-assisted-volume-snapshots => generated 78 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 28 09:49:56.263890 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [req-7894538f-a7fd-43a7-aa5a-f69cfa55d8b7 req-d896109d-561e-48bd-8f88-1647ef62c779 admin admin] Action: 'create', calling method: >, body: {"snapshot": {"volume_id": "0b8e6b7a-1705-480c-9ad7-b8f7126ad09e", "create_info": {"type": "qcow2", "new_file": "volume-0b8e6b7a-1705-480c-9ad7-b8f7126ad09e.3a7c14c1-124b-48d2-a3d1-186bc4756914.vhdx", "snapshot_id": "3a7c14c1-124b-48d2-a3d1-186bc4756914"}}} {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:49:56.267294 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-7894538f-a7fd-43a7-aa5a-f69cfa55d8b7 req-d896109d-561e-48bd-8f88-1647ef62c779 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:56.267811 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-7894538f-a7fd-43a7-aa5a-f69cfa55d8b7 req-d896109d-561e-48bd-8f88-1647ef62c779 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:56.268253 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-7894538f-a7fd-43a7-aa5a-f69cfa55d8b7 req-d896109d-561e-48bd-8f88-1647ef62c779 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:56.276855 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-7894538f-a7fd-43a7-aa5a-f69cfa55d8b7 req-d896109d-561e-48bd-8f88-1647ef62c779 admin admin] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:56.277349 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-7894538f-a7fd-43a7-aa5a-f69cfa55d8b7 req-d896109d-561e-48bd-8f88-1647ef62c779 admin admin] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:56.278318 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-7894538f-a7fd-43a7-aa5a-f69cfa55d8b7 req-d896109d-561e-48bd-8f88-1647ef62c779 admin admin] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:56.291994 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [req-7894538f-a7fd-43a7-aa5a-f69cfa55d8b7 req-d896109d-561e-48bd-8f88-1647ef62c779 admin admin] 10.222.0.58 "POST /compute/v2.1/os-assisted-volume-snapshots" status: 200 len: 78 microversion: 2.1 time: 0.086548 Oct 28 09:49:56.292612 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 263/533] 10.222.0.58 () {64 vars in 1326 bytes} [Fri Oct 28 09:49:56 2022] POST /compute/v2.1/os-assisted-volume-snapshots => generated 78 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 28 09:50:00.360632 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG dbcounter [-] [127032] Writing DB stats nova_api:SELECT=7 {{(pid=127032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:50:00.409828 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [req-2c7454dc-abfa-4fa1-bef8-485fcd04aec7 req-081cc6bc-76cd-45a0-94e9-722ec0f09a31 admin admin] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:00.413198 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-2c7454dc-abfa-4fa1-bef8-485fcd04aec7 req-081cc6bc-76cd-45a0-94e9-722ec0f09a31 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:00.413687 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-2c7454dc-abfa-4fa1-bef8-485fcd04aec7 req-081cc6bc-76cd-45a0-94e9-722ec0f09a31 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:00.414123 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-2c7454dc-abfa-4fa1-bef8-485fcd04aec7 req-081cc6bc-76cd-45a0-94e9-722ec0f09a31 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:00.422660 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-2c7454dc-abfa-4fa1-bef8-485fcd04aec7 req-081cc6bc-76cd-45a0-94e9-722ec0f09a31 admin admin] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:00.423145 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-2c7454dc-abfa-4fa1-bef8-485fcd04aec7 req-081cc6bc-76cd-45a0-94e9-722ec0f09a31 admin admin] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:00.423585 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-2c7454dc-abfa-4fa1-bef8-485fcd04aec7 req-081cc6bc-76cd-45a0-94e9-722ec0f09a31 admin admin] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:00.437543 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [req-2c7454dc-abfa-4fa1-bef8-485fcd04aec7 req-081cc6bc-76cd-45a0-94e9-722ec0f09a31 admin admin] 10.222.0.58 "DELETE /compute/v2.1/os-assisted-volume-snapshots/3a7c14c1-124b-48d2-a3d1-186bc4756914?delete_info=%7B%22file_to_merge%22:%20%22volume-0b8e6b7a-1705-480c-9ad7-b8f7126ad09e.3a7c14c1-124b-48d2-a3d1-186bc4756914.vhdx%22,%20%22volume_id%22:%20%220b8e6b7a-1705-480c-9ad7-b8f7126ad09e%22%7D" status: 204 len: 0 microversion: 2.1 time: 0.082462 Oct 28 09:50:00.438136 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 271/534] 10.222.0.58 () {62 vars in 1800 bytes} [Fri Oct 28 09:50:00 2022] DELETE /compute/v2.1/os-assisted-volume-snapshots/3a7c14c1-124b-48d2-a3d1-186bc4756914?delete_info=%7B%22file_to_merge%22:%20%22volume-0b8e6b7a-1705-480c-9ad7-b8f7126ad09e.3a7c14c1-124b-48d2-a3d1-186bc4756914.vhdx%22,%20%22volume_id%22:%20%220b8e6b7a-1705-480c-9ad7-b8f7126ad09e%22%7D => generated 0 bytes in 84 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 09:50:06.675912 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG dbcounter [-] [127033] Writing DB stats nova_api:SELECT=9 {{(pid=127033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:50:06.676810 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG dbcounter [-] [127033] Writing DB stats nova_cell0:SELECT=2 {{(pid=127033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:50:06.677806 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG dbcounter [-] [127033] Writing DB stats nova_cell1:SELECT=54 {{(pid=127033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:50:06.737678 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [req-8214b2d1-a5a3-43c4-9e8c-778791aacc15 req-f6edbb09-e695-4947-845b-e1f18ca7f528 admin admin] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:06.741030 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-8214b2d1-a5a3-43c4-9e8c-778791aacc15 req-f6edbb09-e695-4947-845b-e1f18ca7f528 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:06.741523 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-8214b2d1-a5a3-43c4-9e8c-778791aacc15 req-f6edbb09-e695-4947-845b-e1f18ca7f528 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:06.741964 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-8214b2d1-a5a3-43c4-9e8c-778791aacc15 req-f6edbb09-e695-4947-845b-e1f18ca7f528 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:06.754246 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-8214b2d1-a5a3-43c4-9e8c-778791aacc15 req-f6edbb09-e695-4947-845b-e1f18ca7f528 admin admin] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:06.754736 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-8214b2d1-a5a3-43c4-9e8c-778791aacc15 req-f6edbb09-e695-4947-845b-e1f18ca7f528 admin admin] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:06.755166 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-8214b2d1-a5a3-43c4-9e8c-778791aacc15 req-f6edbb09-e695-4947-845b-e1f18ca7f528 admin admin] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:06.770029 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [req-8214b2d1-a5a3-43c4-9e8c-778791aacc15 req-f6edbb09-e695-4947-845b-e1f18ca7f528 admin admin] 10.222.0.58 "DELETE /compute/v2.1/os-assisted-volume-snapshots/707bce5d-882c-4014-97d7-160938222069?delete_info=%7B%22file_to_merge%22:%20%22volume-0b8e6b7a-1705-480c-9ad7-b8f7126ad09e.707bce5d-882c-4014-97d7-160938222069.vhdx%22,%20%22volume_id%22:%20%220b8e6b7a-1705-480c-9ad7-b8f7126ad09e%22%7D" status: 204 len: 0 microversion: 2.1 time: 0.095416 Oct 28 09:50:06.770626 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 264/535] 10.222.0.58 () {62 vars in 1800 bytes} [Fri Oct 28 09:50:06 2022] DELETE /compute/v2.1/os-assisted-volume-snapshots/707bce5d-882c-4014-97d7-160938222069?delete_info=%7B%22file_to_merge%22:%20%22volume-0b8e6b7a-1705-480c-9ad7-b8f7126ad09e.707bce5d-882c-4014-97d7-160938222069.vhdx%22,%20%22volume_id%22:%20%220b8e6b7a-1705-480c-9ad7-b8f7126ad09e%22%7D => generated 0 bytes in 97 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 28 09:50:10.868922 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG dbcounter [-] [127032] Writing DB stats nova_cell0:SELECT=4 {{(pid=127032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:50:10.869768 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG dbcounter [-] [127032] Writing DB stats nova_cell1:SELECT=5 {{(pid=127032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:50:10.921515 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [req-9a10c6d8-2196-400e-bab5-232f4369752f req-481b7915-ce3e-4a18-b373-e112777cbcfa admin admin] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:10.924749 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-9a10c6d8-2196-400e-bab5-232f4369752f req-481b7915-ce3e-4a18-b373-e112777cbcfa admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:10.925271 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-9a10c6d8-2196-400e-bab5-232f4369752f req-481b7915-ce3e-4a18-b373-e112777cbcfa admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:10.925679 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-9a10c6d8-2196-400e-bab5-232f4369752f req-481b7915-ce3e-4a18-b373-e112777cbcfa admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:10.935690 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-9a10c6d8-2196-400e-bab5-232f4369752f req-481b7915-ce3e-4a18-b373-e112777cbcfa admin admin] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:10.936209 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-9a10c6d8-2196-400e-bab5-232f4369752f req-481b7915-ce3e-4a18-b373-e112777cbcfa admin admin] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:10.936642 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-9a10c6d8-2196-400e-bab5-232f4369752f req-481b7915-ce3e-4a18-b373-e112777cbcfa admin admin] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:10.951233 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [req-9a10c6d8-2196-400e-bab5-232f4369752f req-481b7915-ce3e-4a18-b373-e112777cbcfa admin admin] 10.222.0.58 "DELETE /compute/v2.1/os-assisted-volume-snapshots/217837e8-03a6-4ee3-b679-b0f6ff227207?delete_info=%7B%22file_to_merge%22:%20%22volume-0b8e6b7a-1705-480c-9ad7-b8f7126ad09e.217837e8-03a6-4ee3-b679-b0f6ff227207.vhdx%22,%20%22volume_id%22:%20%220b8e6b7a-1705-480c-9ad7-b8f7126ad09e%22%7D" status: 204 len: 0 microversion: 2.1 time: 0.083562 Oct 28 09:50:10.951887 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 272/536] 10.222.0.58 () {62 vars in 1800 bytes} [Fri Oct 28 09:50:10 2022] DELETE /compute/v2.1/os-assisted-volume-snapshots/217837e8-03a6-4ee3-b679-b0f6ff227207?delete_info=%7B%22file_to_merge%22:%20%22volume-0b8e6b7a-1705-480c-9ad7-b8f7126ad09e.217837e8-03a6-4ee3-b679-b0f6ff227207.vhdx%22,%20%22volume_id%22:%20%220b8e6b7a-1705-480c-9ad7-b8f7126ad09e%22%7D => generated 0 bytes in 85 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 28 09:50:14.918842 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-1be168dd-ddf0-4ac7-8167-9cf7c1fb57de tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:14.919485 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-1be168dd-ddf0-4ac7-8167-9cf7c1fb57de tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] [instance: 59cbacea-5702-4207-a63b-6ebc3f652dac] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:50:14.925696 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-1be168dd-ddf0-4ac7-8167-9cf7c1fb57de tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:14.926199 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-1be168dd-ddf0-4ac7-8167-9cf7c1fb57de tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:14.926635 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-1be168dd-ddf0-4ac7-8167-9cf7c1fb57de tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:14.927326 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-1be168dd-ddf0-4ac7-8167-9cf7c1fb57de tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:14.927804 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-1be168dd-ddf0-4ac7-8167-9cf7c1fb57de tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:14.928233 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-1be168dd-ddf0-4ac7-8167-9cf7c1fb57de tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:15.011125 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.objects.instance [None req-1be168dd-ddf0-4ac7-8167-9cf7c1fb57de tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lazy-loading 'services' on Instance uuid 59cbacea-5702-4207-a63b-6ebc3f652dac {{(pid=127033) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:50:15.092432 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-1be168dd-ddf0-4ac7-8167-9cf7c1fb57de tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] 10.222.0.52 "DELETE /compute/v2.1/servers/59cbacea-5702-4207-a63b-6ebc3f652dac/os-volume_attachments/0b8e6b7a-1705-480c-9ad7-b8f7126ad09e" status: 202 len: 0 microversion: 2.1 time: 0.178290 Oct 28 09:50:15.093080 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 265/537] 10.222.0.52 () {58 vars in 1416 bytes} [Fri Oct 28 09:50:14 2022] DELETE /compute/v2.1/servers/59cbacea-5702-4207-a63b-6ebc3f652dac/os-volume_attachments/0b8e6b7a-1705-480c-9ad7-b8f7126ad09e => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:50:16.913761 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-4943699d-ffaa-4fb1-b9a4-12a43702536e tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:16.914296 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-4943699d-ffaa-4fb1-b9a4-12a43702536e tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] [instance: 91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:50:16.921228 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-4943699d-ffaa-4fb1-b9a4-12a43702536e tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:16.921712 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-4943699d-ffaa-4fb1-b9a4-12a43702536e tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:16.922144 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-4943699d-ffaa-4fb1-b9a4-12a43702536e tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:16.922850 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-4943699d-ffaa-4fb1-b9a4-12a43702536e tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:16.923300 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-4943699d-ffaa-4fb1-b9a4-12a43702536e tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:16.923722 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-4943699d-ffaa-4fb1-b9a4-12a43702536e tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:17.055414 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.objects.instance [None req-4943699d-ffaa-4fb1-b9a4-12a43702536e tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lazy-loading 'services' on Instance uuid 91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1 {{(pid=127032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:50:17.175984 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-4943699d-ffaa-4fb1-b9a4-12a43702536e tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] 10.222.0.52 "DELETE /compute/v2.1/servers/91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1/os-volume_attachments/012eec24-1204-4f92-975f-b199759c950b" status: 202 len: 0 microversion: 2.1 time: 0.266910 Oct 28 09:50:17.176613 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 273/538] 10.222.0.52 () {58 vars in 1416 bytes} [Fri Oct 28 09:50:16 2022] DELETE /compute/v2.1/servers/91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1/os-volume_attachments/012eec24-1204-4f92-975f-b199759c950b => generated 0 bytes in 269 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:50:17.286060 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG dbcounter [-] [127033] Writing DB stats nova_cell0:SELECT=2 {{(pid=127033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:50:17.290179 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-8ee8d216-0e3a-493e-9a3d-9c01f3ea367e tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:17.290771 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-8ee8d216-0e3a-493e-9a3d-9c01f3ea367e tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] [instance: 59cbacea-5702-4207-a63b-6ebc3f652dac] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:50:17.297905 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-8ee8d216-0e3a-493e-9a3d-9c01f3ea367e tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:17.298396 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-8ee8d216-0e3a-493e-9a3d-9c01f3ea367e tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:17.298848 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-8ee8d216-0e3a-493e-9a3d-9c01f3ea367e tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:17.299520 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-8ee8d216-0e3a-493e-9a3d-9c01f3ea367e tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:17.299999 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-8ee8d216-0e3a-493e-9a3d-9c01f3ea367e tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:17.300427 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-8ee8d216-0e3a-493e-9a3d-9c01f3ea367e tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:17.325693 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-8ee8d216-0e3a-493e-9a3d-9c01f3ea367e tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] [instance: 59cbacea-5702-4207-a63b-6ebc3f652dac] Going to try to terminate instance {{(pid=127033) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 09:50:17.399190 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-8ee8d216-0e3a-493e-9a3d-9c01f3ea367e tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] 10.222.0.52 "DELETE /compute/v2.1/servers/59cbacea-5702-4207-a63b-6ebc3f652dac" status: 204 len: 0 microversion: 2.1 time: 0.114328 Oct 28 09:50:17.399783 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 266/539] 10.222.0.52 () {58 vars in 1239 bytes} [Fri Oct 28 09:50:17 2022] DELETE /compute/v2.1/servers/59cbacea-5702-4207-a63b-6ebc3f652dac => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 09:50:17.409286 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-2984f619-c386-4c40-8f6b-0dc5600ac19a tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:17.410021 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-2984f619-c386-4c40-8f6b-0dc5600ac19a tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] [instance: 59cbacea-5702-4207-a63b-6ebc3f652dac] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:50:17.416108 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-2984f619-c386-4c40-8f6b-0dc5600ac19a tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:17.416590 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-2984f619-c386-4c40-8f6b-0dc5600ac19a tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:17.417027 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-2984f619-c386-4c40-8f6b-0dc5600ac19a tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:17.417716 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-2984f619-c386-4c40-8f6b-0dc5600ac19a tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:17.418173 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-2984f619-c386-4c40-8f6b-0dc5600ac19a tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:17.418594 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-2984f619-c386-4c40-8f6b-0dc5600ac19a tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:17.548792 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-2984f619-c386-4c40-8f6b-0dc5600ac19a tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36846c3821c14284893e25dd143d11e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1d6189cfd4437a13a0908119c7ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:17.556461 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-2984f619-c386-4c40-8f6b-0dc5600ac19a tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] 10.222.0.52 "GET /compute/v2.1/servers/59cbacea-5702-4207-a63b-6ebc3f652dac" status: 200 len: 1512 microversion: 2.1 time: 0.151522 Oct 28 09:50:17.557038 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 274/540] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:50:17 2022] GET /compute/v2.1/servers/59cbacea-5702-4207-a63b-6ebc3f652dac => generated 1512 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:18.580455 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-4bb1cd95-80fb-4a27-8de7-ea27ed159fb3 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:18.581152 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-4bb1cd95-80fb-4a27-8de7-ea27ed159fb3 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] [instance: 59cbacea-5702-4207-a63b-6ebc3f652dac] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:50:18.587552 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-4bb1cd95-80fb-4a27-8de7-ea27ed159fb3 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:18.588076 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-4bb1cd95-80fb-4a27-8de7-ea27ed159fb3 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:18.588512 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-4bb1cd95-80fb-4a27-8de7-ea27ed159fb3 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:18.589203 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-4bb1cd95-80fb-4a27-8de7-ea27ed159fb3 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:18.589658 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-4bb1cd95-80fb-4a27-8de7-ea27ed159fb3 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:18.590624 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-4bb1cd95-80fb-4a27-8de7-ea27ed159fb3 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:18.721845 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-4bb1cd95-80fb-4a27-8de7-ea27ed159fb3 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36846c3821c14284893e25dd143d11e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1d6189cfd4437a13a0908119c7ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:18.729734 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-4bb1cd95-80fb-4a27-8de7-ea27ed159fb3 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] 10.222.0.52 "GET /compute/v2.1/servers/59cbacea-5702-4207-a63b-6ebc3f652dac" status: 200 len: 1512 microversion: 2.1 time: 0.153448 Oct 28 09:50:18.730314 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 267/541] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:50:18 2022] GET /compute/v2.1/servers/59cbacea-5702-4207-a63b-6ebc3f652dac => generated 1512 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:19.754363 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-8ba2f872-b579-46a2-811a-1bdb1fa19761 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:19.755044 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-8ba2f872-b579-46a2-811a-1bdb1fa19761 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] [instance: 59cbacea-5702-4207-a63b-6ebc3f652dac] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:50:19.761521 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-8ba2f872-b579-46a2-811a-1bdb1fa19761 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:19.761999 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-8ba2f872-b579-46a2-811a-1bdb1fa19761 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:19.762430 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-8ba2f872-b579-46a2-811a-1bdb1fa19761 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:19.763130 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-8ba2f872-b579-46a2-811a-1bdb1fa19761 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:19.763586 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-8ba2f872-b579-46a2-811a-1bdb1fa19761 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:19.764065 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-8ba2f872-b579-46a2-811a-1bdb1fa19761 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:19.892266 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-8ba2f872-b579-46a2-811a-1bdb1fa19761 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36846c3821c14284893e25dd143d11e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1d6189cfd4437a13a0908119c7ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:19.900054 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-8ba2f872-b579-46a2-811a-1bdb1fa19761 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] 10.222.0.52 "GET /compute/v2.1/servers/59cbacea-5702-4207-a63b-6ebc3f652dac" status: 200 len: 1512 microversion: 2.1 time: 0.149515 Oct 28 09:50:19.900633 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 275/542] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:50:19 2022] GET /compute/v2.1/servers/59cbacea-5702-4207-a63b-6ebc3f652dac => generated 1512 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:20.923582 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-103c6b0c-6a9d-45ae-85de-99de8712629c tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:20.924296 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-103c6b0c-6a9d-45ae-85de-99de8712629c tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] [instance: 59cbacea-5702-4207-a63b-6ebc3f652dac] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:50:20.930681 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-103c6b0c-6a9d-45ae-85de-99de8712629c tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:20.931164 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-103c6b0c-6a9d-45ae-85de-99de8712629c tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:20.931590 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-103c6b0c-6a9d-45ae-85de-99de8712629c tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:20.932320 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-103c6b0c-6a9d-45ae-85de-99de8712629c tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:20.932771 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-103c6b0c-6a9d-45ae-85de-99de8712629c tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:20.933188 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-103c6b0c-6a9d-45ae-85de-99de8712629c tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:21.070070 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-103c6b0c-6a9d-45ae-85de-99de8712629c tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36846c3821c14284893e25dd143d11e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1d6189cfd4437a13a0908119c7ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:21.078686 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-103c6b0c-6a9d-45ae-85de-99de8712629c tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] 10.222.0.52 "GET /compute/v2.1/servers/59cbacea-5702-4207-a63b-6ebc3f652dac" status: 200 len: 1512 microversion: 2.1 time: 0.159399 Oct 28 09:50:21.079279 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 268/543] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:50:20 2022] GET /compute/v2.1/servers/59cbacea-5702-4207-a63b-6ebc3f652dac => generated 1512 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:22.105762 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-11a827ef-2323-4cc5-9558-7e053e3a77fe tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:22.106894 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-11a827ef-2323-4cc5-9558-7e053e3a77fe tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] [instance: 59cbacea-5702-4207-a63b-6ebc3f652dac] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:50:22.109409 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG dbcounter [-] [127032] Writing DB stats nova_cell0:SELECT=2 {{(pid=127032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:50:22.115482 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-11a827ef-2323-4cc5-9558-7e053e3a77fe tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:22.116113 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-11a827ef-2323-4cc5-9558-7e053e3a77fe tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:22.116454 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-11a827ef-2323-4cc5-9558-7e053e3a77fe tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:22.117162 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-11a827ef-2323-4cc5-9558-7e053e3a77fe tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:22.117619 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-11a827ef-2323-4cc5-9558-7e053e3a77fe tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:22.118091 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-11a827ef-2323-4cc5-9558-7e053e3a77fe tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:22.363143 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-11a827ef-2323-4cc5-9558-7e053e3a77fe tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36846c3821c14284893e25dd143d11e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1d6189cfd4437a13a0908119c7ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:22.378286 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-11a827ef-2323-4cc5-9558-7e053e3a77fe tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] 10.222.0.52 "GET /compute/v2.1/servers/59cbacea-5702-4207-a63b-6ebc3f652dac" status: 200 len: 1512 microversion: 2.1 time: 0.275889 Oct 28 09:50:22.379724 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 276/544] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:50:22 2022] GET /compute/v2.1/servers/59cbacea-5702-4207-a63b-6ebc3f652dac => generated 1512 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:22.549743 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-22c4cbb6-17a1-4af0-b07b-dd09843594b2 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:50:22.556283 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-22c4cbb6-17a1-4af0-b07b-dd09843594b2 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:22.557358 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-22c4cbb6-17a1-4af0-b07b-dd09843594b2 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:22.557358 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-22c4cbb6-17a1-4af0-b07b-dd09843594b2 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:22.580294 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-22c4cbb6-17a1-4af0-b07b-dd09843594b2 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] [instance: 91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1] Going to try to stop instance {{(pid=127033) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 28 09:50:22.624688 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-22c4cbb6-17a1-4af0-b07b-dd09843594b2 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] 10.222.0.52 "POST /compute/v2.1/servers/91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1/action" status: 202 len: 0 microversion: 2.1 time: 0.078753 Oct 28 09:50:22.625294 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 269/545] 10.222.0.52 () {60 vars in 1278 bytes} [Fri Oct 28 09:50:22 2022] POST /compute/v2.1/servers/91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:50:22.633577 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-e0926fed-0229-4612-90f0-84be43723e90 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:22.634185 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-e0926fed-0229-4612-90f0-84be43723e90 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] [instance: 91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:50:22.640956 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-e0926fed-0229-4612-90f0-84be43723e90 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:22.641451 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-e0926fed-0229-4612-90f0-84be43723e90 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:22.641884 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-e0926fed-0229-4612-90f0-84be43723e90 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:22.642584 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-e0926fed-0229-4612-90f0-84be43723e90 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:22.643035 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-e0926fed-0229-4612-90f0-84be43723e90 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:22.643614 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-e0926fed-0229-4612-90f0-84be43723e90 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:22.793302 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-e0926fed-0229-4612-90f0-84be43723e90 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bee2d5f599642788c32e0d8b8338c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e7d531c0f4a33a869309af965e3e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:22.801155 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-e0926fed-0229-4612-90f0-84be43723e90 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] 10.222.0.52 "GET /compute/v2.1/servers/91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1" status: 200 len: 1676 microversion: 2.1 time: 0.171495 Oct 28 09:50:22.801736 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 277/546] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:50:22 2022] GET /compute/v2.1/servers/91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1 => generated 1676 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:23.415566 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-d3f945b4-36f7-490c-8553-4336babf4712 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:23.416218 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-d3f945b4-36f7-490c-8553-4336babf4712 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] [instance: 59cbacea-5702-4207-a63b-6ebc3f652dac] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:50:23.422799 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-d3f945b4-36f7-490c-8553-4336babf4712 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:23.423295 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-d3f945b4-36f7-490c-8553-4336babf4712 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:23.423729 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-d3f945b4-36f7-490c-8553-4336babf4712 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:23.424453 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-d3f945b4-36f7-490c-8553-4336babf4712 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:23.424910 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-d3f945b4-36f7-490c-8553-4336babf4712 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:23.425355 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-d3f945b4-36f7-490c-8553-4336babf4712 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:23.549263 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-d3f945b4-36f7-490c-8553-4336babf4712 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36846c3821c14284893e25dd143d11e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1d6189cfd4437a13a0908119c7ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:23.557600 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-d3f945b4-36f7-490c-8553-4336babf4712 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] 10.222.0.52 "GET /compute/v2.1/servers/59cbacea-5702-4207-a63b-6ebc3f652dac" status: 200 len: 1470 microversion: 2.1 time: 0.146319 Oct 28 09:50:23.558251 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 270/547] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:50:23 2022] GET /compute/v2.1/servers/59cbacea-5702-4207-a63b-6ebc3f652dac => generated 1470 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:23.583398 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [req-866fbbd5-34e9-4075-baa1-262977f8f19f req-2a1243e4-f306-4a75-905a-7c05722562ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59cbacea-5702-4207-a63b-6ebc3f652dac", "name": "network-vif-deleted", "tag": "4cb8c638-6008-4746-b380-34937ebffc1b"}]} {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:50:23.596383 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-866fbbd5-34e9-4075-baa1-262977f8f19f req-2a1243e4-f306-4a75-905a-7c05722562ab service nova] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:23.596850 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-866fbbd5-34e9-4075-baa1-262977f8f19f req-2a1243e4-f306-4a75-905a-7c05722562ab service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:23.597274 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-866fbbd5-34e9-4075-baa1-262977f8f19f req-2a1243e4-f306-4a75-905a-7c05722562ab service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:23.612042 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.compute.server_external_events [req-866fbbd5-34e9-4075-baa1-262977f8f19f req-2a1243e4-f306-4a75-905a-7c05722562ab service nova] Creating event network-vif-deleted:4cb8c638-6008-4746-b380-34937ebffc1b for instance 59cbacea-5702-4207-a63b-6ebc3f652dac on hv-cinder-zed-3 Oct 28 09:50:23.618839 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [req-866fbbd5-34e9-4075-baa1-262977f8f19f req-2a1243e4-f306-4a75-905a-7c05722562ab service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038608 Oct 28 09:50:23.619459 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 278/548] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Oct 28 09:50:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 09:50:23.825938 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-56d9d894-6c75-43b7-bbfd-a048a0f54eb0 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:23.826540 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-56d9d894-6c75-43b7-bbfd-a048a0f54eb0 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] [instance: 91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:50:23.832628 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-56d9d894-6c75-43b7-bbfd-a048a0f54eb0 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:23.833109 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-56d9d894-6c75-43b7-bbfd-a048a0f54eb0 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:23.833543 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-56d9d894-6c75-43b7-bbfd-a048a0f54eb0 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:23.834440 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-56d9d894-6c75-43b7-bbfd-a048a0f54eb0 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:23.834901 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-56d9d894-6c75-43b7-bbfd-a048a0f54eb0 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:23.835316 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-56d9d894-6c75-43b7-bbfd-a048a0f54eb0 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:23.983010 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-56d9d894-6c75-43b7-bbfd-a048a0f54eb0 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bee2d5f599642788c32e0d8b8338c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e7d531c0f4a33a869309af965e3e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:23.991199 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-56d9d894-6c75-43b7-bbfd-a048a0f54eb0 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] 10.222.0.52 "GET /compute/v2.1/servers/91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1" status: 200 len: 1676 microversion: 2.1 time: 0.169694 Oct 28 09:50:23.991848 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 271/549] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:50:23 2022] GET /compute/v2.1/servers/91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1 => generated 1676 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:24.583435 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-47c24f70-311b-4277-b2ec-8dfce991467f tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:24.584291 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-47c24f70-311b-4277-b2ec-8dfce991467f tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] [instance: 59cbacea-5702-4207-a63b-6ebc3f652dac] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:50:24.590687 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-47c24f70-311b-4277-b2ec-8dfce991467f tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:24.591164 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-47c24f70-311b-4277-b2ec-8dfce991467f tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:24.591589 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-47c24f70-311b-4277-b2ec-8dfce991467f tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:24.592318 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-47c24f70-311b-4277-b2ec-8dfce991467f tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:24.592762 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-47c24f70-311b-4277-b2ec-8dfce991467f tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:24.593177 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-47c24f70-311b-4277-b2ec-8dfce991467f tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:24.628306 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-47c24f70-311b-4277-b2ec-8dfce991467f tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:24.628790 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-47c24f70-311b-4277-b2ec-8dfce991467f tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:24.629219 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-47c24f70-311b-4277-b2ec-8dfce991467f tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:24.629678 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.objects.instance [None req-47c24f70-311b-4277-b2ec-8dfce991467f tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lazy-loading 'fault' on Instance uuid 59cbacea-5702-4207-a63b-6ebc3f652dac {{(pid=127032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:50:24.686653 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-47c24f70-311b-4277-b2ec-8dfce991467f tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36846c3821c14284893e25dd143d11e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1d6189cfd4437a13a0908119c7ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:24.695947 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-47c24f70-311b-4277-b2ec-8dfce991467f tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] 10.222.0.52 "GET /compute/v2.1/servers/59cbacea-5702-4207-a63b-6ebc3f652dac" status: 200 len: 1308 microversion: 2.1 time: 0.117502 Oct 28 09:50:24.696633 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 279/550] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:50:24 2022] GET /compute/v2.1/servers/59cbacea-5702-4207-a63b-6ebc3f652dac => generated 1308 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:25.014847 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-319fb424-2525-4cc3-a19a-9b34dc1ac216 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:25.015462 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-319fb424-2525-4cc3-a19a-9b34dc1ac216 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] [instance: 91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:50:25.022154 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-319fb424-2525-4cc3-a19a-9b34dc1ac216 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:25.022643 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-319fb424-2525-4cc3-a19a-9b34dc1ac216 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:25.023082 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-319fb424-2525-4cc3-a19a-9b34dc1ac216 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:25.023792 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-319fb424-2525-4cc3-a19a-9b34dc1ac216 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:25.024257 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-319fb424-2525-4cc3-a19a-9b34dc1ac216 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:25.024679 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-319fb424-2525-4cc3-a19a-9b34dc1ac216 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:25.153958 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-319fb424-2525-4cc3-a19a-9b34dc1ac216 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bee2d5f599642788c32e0d8b8338c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e7d531c0f4a33a869309af965e3e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:25.161759 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-319fb424-2525-4cc3-a19a-9b34dc1ac216 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] 10.222.0.52 "GET /compute/v2.1/servers/91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1" status: 200 len: 1676 microversion: 2.1 time: 0.151032 Oct 28 09:50:25.162254 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 272/551] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:50:25 2022] GET /compute/v2.1/servers/91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1 => generated 1676 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:25.737232 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-2af4a235-6f16-47fa-82f0-37abbf086c75 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:25.737860 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-2af4a235-6f16-47fa-82f0-37abbf086c75 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] [instance: 59cbacea-5702-4207-a63b-6ebc3f652dac] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:50:25.744322 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-2af4a235-6f16-47fa-82f0-37abbf086c75 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:25.744798 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-2af4a235-6f16-47fa-82f0-37abbf086c75 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:25.745223 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-2af4a235-6f16-47fa-82f0-37abbf086c75 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:25.745918 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-2af4a235-6f16-47fa-82f0-37abbf086c75 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:25.746359 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-2af4a235-6f16-47fa-82f0-37abbf086c75 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:25.747413 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-2af4a235-6f16-47fa-82f0-37abbf086c75 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:25.761741 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.wsgi [None req-2af4a235-6f16-47fa-82f0-37abbf086c75 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] HTTP exception thrown: Instance 59cbacea-5702-4207-a63b-6ebc3f652dac could not be found. Oct 28 09:50:25.763413 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-2af4a235-6f16-47fa-82f0-37abbf086c75 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Request method failure captured: Oct 28 09:50:25.763413 dv-cinder-zed-3-smb devstack@n-api.service[127032]: request: GET /compute/v2.1/servers/59cbacea-5702-4207-a63b-6ebc3f652dac HTTP/1.1 Oct 28 09:50:25.763413 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Accept: application/json Oct 28 09:50:25.763413 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Accept-Encoding: identity Oct 28 09:50:25.763413 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Connection: close Oct 28 09:50:25.763413 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Content-Length: 0 Oct 28 09:50:25.763413 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Content-Type: application/json Oct 28 09:50:25.763413 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Host: 10.222.0.52 Oct 28 09:50:25.763413 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Openstack-System-Scope: None Oct 28 09:50:25.763413 dv-cinder-zed-3-smb devstack@n-api.service[127032]: User-Agent: python-urllib3/1.26.12 Oct 28 09:50:25.763413 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Auth-Token: gAAAAABjW6UeREZawYM0XxhAV7I0ovB8P-fqeZJFCZISpXyi9qYXYlsKWmn8HSw2DTGwdkvvQONsxRyerfu3yEtCD4eH0d98UozJ7OqPLdn3g_nU7gYfrz9dwNM_1G7h521QnQWOY-fawHwU0VvFaaTNj6Fz8EszUkF9B1LMEn6Ozg_oQqHGIu4 Oct 28 09:50:25.763413 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Domain-Id: None Oct 28 09:50:25.763413 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Domain-Name: None Oct 28 09:50:25.763413 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Identity-Status: Confirmed Oct 28 09:50:25.763413 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Is-Admin-Project: True Oct 28 09:50:25.763413 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Project-Domain-Id: default Oct 28 09:50:25.763413 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Project-Domain-Name: Default Oct 28 09:50:25.763413 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Project-Id: 23f1d6189cfd4437a13a0908119c7ecb Oct 28 09:50:25.763413 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Project-Name: tempest-VolumesSnapshotTestJSON-571579702 Oct 28 09:50:25.763413 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Role: reader,member Oct 28 09:50:25.763413 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Roles: reader,member Oct 28 09:50:25.765062 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_23f1d6189cfd4437a13a0908119c7ecb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/23f1d6189cfd4437a13a0908119c7ecb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/23f1d6189cfd4437a13a0908119c7ecb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/23f1d6189cfd4437a13a0908119c7ecb"}]}] Oct 28 09:50:25.765062 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Tenant: tempest-VolumesSnapshotTestJSON-571579702 Oct 28 09:50:25.765062 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Tenant-Id: 23f1d6189cfd4437a13a0908119c7ecb Oct 28 09:50:25.765062 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-571579702 Oct 28 09:50:25.765062 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-User: tempest-VolumesSnapshotTestJSON-571579702-project Oct 28 09:50:25.765062 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-User-Domain-Id: default Oct 28 09:50:25.765062 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-User-Domain-Name: Default Oct 28 09:50:25.765062 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-User-Id: 36846c3821c14284893e25dd143d11e2 Oct 28 09:50:25.765062 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-User-Name: tempest-VolumesSnapshotTestJSON-571579702-project Oct 28 09:50:25.765062 dv-cinder-zed-3-smb devstack@n-api.service[127032]: method: > Oct 28 09:50:25.765062 dv-cinder-zed-3-smb devstack@n-api.service[127032]: exception: Instance 59cbacea-5702-4207-a63b-6ebc3f652dac could not be found. Oct 28 09:50:25.765062 dv-cinder-zed-3-smb devstack@n-api.service[127032]: action_args: {'id': '59cbacea-5702-4207-a63b-6ebc3f652dac'} Oct 28 09:50:25.766391 dv-cinder-zed-3-smb devstack@n-api.service[127032]: {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:50:25.766391 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:50:25.766391 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 09:50:25.766391 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 09:50:25.766391 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 09:50:25.766391 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 09:50:25.766391 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 09:50:25.766391 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 09:50:25.766391 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 09:50:25.766391 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 09:50:25.766391 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59cbacea-5702-4207-a63b-6ebc3f652dac could not be found. Oct 28 09:50:25.766391 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Oct 28 09:50:25.766391 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:50:25.766391 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Oct 28 09:50:25.766391 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:50:25.766391 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:50:25.766391 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:50:25.766391 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:50:25.766391 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:50:25.766391 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:50:25.767883 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:50:25.767883 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 09:50:25.767883 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 09:50:25.767883 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 09:50:25.767883 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 09:50:25.767883 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 09:50:25.767883 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 09:50:25.767883 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59cbacea-5702-4207-a63b-6ebc3f652dac could not be found. Oct 28 09:50:25.767883 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Oct 28 09:50:25.767883 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:50:25.767883 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Oct 28 09:50:25.767883 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:50:25.767883 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:50:25.767883 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:50:25.767883 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:50:25.767883 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:50:25.767883 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59cbacea-5702-4207-a63b-6ebc3f652dac could not be found. Oct 28 09:50:25.767883 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Oct 28 09:50:25.769439 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-2af4a235-6f16-47fa-82f0-37abbf086c75 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] Returning 404 to user: Instance 59cbacea-5702-4207-a63b-6ebc3f652dac could not be found. {{(pid=127032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:50:25.769439 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-2af4a235-6f16-47fa-82f0-37abbf086c75 tempest-VolumesSnapshotTestJSON-571579702 tempest-VolumesSnapshotTestJSON-571579702-project] 10.222.0.52 "GET /compute/v2.1/servers/59cbacea-5702-4207-a63b-6ebc3f652dac" status: 404 len: 111 microversion: 2.1 time: 0.031776 Oct 28 09:50:25.769439 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 280/552] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:50:25 2022] GET /compute/v2.1/servers/59cbacea-5702-4207-a63b-6ebc3f652dac => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:50:26.185631 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-8138d933-f256-46f6-8952-a742110f5b36 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:26.186245 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-8138d933-f256-46f6-8952-a742110f5b36 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] [instance: 91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:50:26.192755 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-8138d933-f256-46f6-8952-a742110f5b36 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:26.193235 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-8138d933-f256-46f6-8952-a742110f5b36 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:26.193668 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-8138d933-f256-46f6-8952-a742110f5b36 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:26.194365 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-8138d933-f256-46f6-8952-a742110f5b36 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:26.194819 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-8138d933-f256-46f6-8952-a742110f5b36 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:26.195256 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-8138d933-f256-46f6-8952-a742110f5b36 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:26.329077 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-8138d933-f256-46f6-8952-a742110f5b36 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bee2d5f599642788c32e0d8b8338c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e7d531c0f4a33a869309af965e3e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:26.337039 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-8138d933-f256-46f6-8952-a742110f5b36 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] 10.222.0.52 "GET /compute/v2.1/servers/91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1" status: 200 len: 1676 microversion: 2.1 time: 0.155282 Oct 28 09:50:26.337635 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 273/553] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:50:26 2022] GET /compute/v2.1/servers/91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1 => generated 1676 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:27.362083 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-4d39c59e-6bd6-4677-ba77-4592724d9451 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:27.362670 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-4d39c59e-6bd6-4677-ba77-4592724d9451 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] [instance: 91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:50:27.369454 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-4d39c59e-6bd6-4677-ba77-4592724d9451 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:27.369953 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-4d39c59e-6bd6-4677-ba77-4592724d9451 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:27.370392 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-4d39c59e-6bd6-4677-ba77-4592724d9451 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:27.371464 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-4d39c59e-6bd6-4677-ba77-4592724d9451 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:27.372581 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-4d39c59e-6bd6-4677-ba77-4592724d9451 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:27.373004 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-4d39c59e-6bd6-4677-ba77-4592724d9451 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:27.524626 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-4d39c59e-6bd6-4677-ba77-4592724d9451 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bee2d5f599642788c32e0d8b8338c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e7d531c0f4a33a869309af965e3e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:27.538164 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-4d39c59e-6bd6-4677-ba77-4592724d9451 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] 10.222.0.52 "GET /compute/v2.1/servers/91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1" status: 200 len: 1676 microversion: 2.1 time: 0.179936 Oct 28 09:50:27.539337 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 281/554] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:50:27 2022] GET /compute/v2.1/servers/91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1 => generated 1676 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:28.562872 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-65c6ee6f-ba7a-4bdd-9992-9b79e3ec69b2 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:28.563391 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-65c6ee6f-ba7a-4bdd-9992-9b79e3ec69b2 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] [instance: 91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:50:28.570016 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-65c6ee6f-ba7a-4bdd-9992-9b79e3ec69b2 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:28.570510 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-65c6ee6f-ba7a-4bdd-9992-9b79e3ec69b2 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:28.570947 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-65c6ee6f-ba7a-4bdd-9992-9b79e3ec69b2 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:28.571698 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-65c6ee6f-ba7a-4bdd-9992-9b79e3ec69b2 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:28.572115 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-65c6ee6f-ba7a-4bdd-9992-9b79e3ec69b2 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:28.572540 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-65c6ee6f-ba7a-4bdd-9992-9b79e3ec69b2 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:28.722653 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-65c6ee6f-ba7a-4bdd-9992-9b79e3ec69b2 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bee2d5f599642788c32e0d8b8338c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e7d531c0f4a33a869309af965e3e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:28.730590 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-65c6ee6f-ba7a-4bdd-9992-9b79e3ec69b2 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] 10.222.0.52 "GET /compute/v2.1/servers/91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1" status: 200 len: 1676 microversion: 2.1 time: 0.171869 Oct 28 09:50:28.731199 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 274/555] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:50:28 2022] GET /compute/v2.1/servers/91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1 => generated 1676 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:29.755318 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-f27c37ea-0f78-4886-a867-7e099f03b6f4 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:29.755968 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-f27c37ea-0f78-4886-a867-7e099f03b6f4 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] [instance: 91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:50:29.764729 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-f27c37ea-0f78-4886-a867-7e099f03b6f4 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:29.765220 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-f27c37ea-0f78-4886-a867-7e099f03b6f4 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:29.765654 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-f27c37ea-0f78-4886-a867-7e099f03b6f4 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:29.766574 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-f27c37ea-0f78-4886-a867-7e099f03b6f4 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:29.766804 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-f27c37ea-0f78-4886-a867-7e099f03b6f4 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:29.767220 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-f27c37ea-0f78-4886-a867-7e099f03b6f4 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:29.918442 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-f27c37ea-0f78-4886-a867-7e099f03b6f4 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bee2d5f599642788c32e0d8b8338c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e7d531c0f4a33a869309af965e3e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:29.926307 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-f27c37ea-0f78-4886-a867-7e099f03b6f4 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] 10.222.0.52 "GET /compute/v2.1/servers/91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1" status: 200 len: 1676 microversion: 2.1 time: 0.174820 Oct 28 09:50:29.926877 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 282/556] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:50:29 2022] GET /compute/v2.1/servers/91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1 => generated 1676 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:30.950277 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-46f9e067-938c-48c8-92be-be7f82c2f5ed tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:30.950922 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-46f9e067-938c-48c8-92be-be7f82c2f5ed tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] [instance: 91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:50:30.958242 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-46f9e067-938c-48c8-92be-be7f82c2f5ed tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:30.959032 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-46f9e067-938c-48c8-92be-be7f82c2f5ed tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:30.959700 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-46f9e067-938c-48c8-92be-be7f82c2f5ed tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:30.960405 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-46f9e067-938c-48c8-92be-be7f82c2f5ed tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:30.961105 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-46f9e067-938c-48c8-92be-be7f82c2f5ed tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:30.961736 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-46f9e067-938c-48c8-92be-be7f82c2f5ed tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:31.141682 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-46f9e067-938c-48c8-92be-be7f82c2f5ed tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bee2d5f599642788c32e0d8b8338c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e7d531c0f4a33a869309af965e3e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:31.150370 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-46f9e067-938c-48c8-92be-be7f82c2f5ed tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] 10.222.0.52 "GET /compute/v2.1/servers/91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1" status: 200 len: 1676 microversion: 2.1 time: 0.204019 Oct 28 09:50:31.151033 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 275/557] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:50:30 2022] GET /compute/v2.1/servers/91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1 => generated 1676 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:32.179780 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-b9962f0e-34f2-435f-8ce9-2baff1141072 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:32.181496 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-b9962f0e-34f2-435f-8ce9-2baff1141072 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] [instance: 91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:50:32.189342 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-b9962f0e-34f2-435f-8ce9-2baff1141072 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:32.189829 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-b9962f0e-34f2-435f-8ce9-2baff1141072 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:32.190259 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-b9962f0e-34f2-435f-8ce9-2baff1141072 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:32.190973 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-b9962f0e-34f2-435f-8ce9-2baff1141072 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:32.191426 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-b9962f0e-34f2-435f-8ce9-2baff1141072 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:32.191884 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-b9962f0e-34f2-435f-8ce9-2baff1141072 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:32.365216 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-b9962f0e-34f2-435f-8ce9-2baff1141072 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bee2d5f599642788c32e0d8b8338c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e7d531c0f4a33a869309af965e3e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:32.375218 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-b9962f0e-34f2-435f-8ce9-2baff1141072 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] 10.222.0.52 "GET /compute/v2.1/servers/91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1" status: 200 len: 1676 microversion: 2.1 time: 0.199254 Oct 28 09:50:32.375956 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 283/558] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:50:32 2022] GET /compute/v2.1/servers/91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1 => generated 1676 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:50:33.405345 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-ce5ba323-da86-4fe1-a2a6-3eb08cbcccde tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:33.406382 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-ce5ba323-da86-4fe1-a2a6-3eb08cbcccde tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] [instance: 91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:50:33.417143 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-ce5ba323-da86-4fe1-a2a6-3eb08cbcccde tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:33.417989 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-ce5ba323-da86-4fe1-a2a6-3eb08cbcccde tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:33.419312 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-ce5ba323-da86-4fe1-a2a6-3eb08cbcccde tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:33.420575 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-ce5ba323-da86-4fe1-a2a6-3eb08cbcccde tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:33.421677 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-ce5ba323-da86-4fe1-a2a6-3eb08cbcccde tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:33.422096 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-ce5ba323-da86-4fe1-a2a6-3eb08cbcccde tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:33.583104 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-ce5ba323-da86-4fe1-a2a6-3eb08cbcccde tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bee2d5f599642788c32e0d8b8338c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e7d531c0f4a33a869309af965e3e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:33.594073 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-ce5ba323-da86-4fe1-a2a6-3eb08cbcccde tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] 10.222.0.52 "GET /compute/v2.1/servers/91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1" status: 200 len: 1653 microversion: 2.1 time: 0.196473 Oct 28 09:50:33.594906 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 276/559] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:50:33 2022] GET /compute/v2.1/servers/91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1 => generated 1653 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:33.619453 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-91c08160-eebb-4553-8673-96826591b613 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:50:33.627705 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-91c08160-eebb-4553-8673-96826591b613 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:33.628565 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-91c08160-eebb-4553-8673-96826591b613 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:33.629023 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-91c08160-eebb-4553-8673-96826591b613 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:33.656026 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-91c08160-eebb-4553-8673-96826591b613 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] [instance: 91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1] Going to try to start instance {{(pid=127032) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 28 09:50:33.703804 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-91c08160-eebb-4553-8673-96826591b613 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] 10.222.0.52 "POST /compute/v2.1/servers/91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1/action" status: 202 len: 0 microversion: 2.1 time: 0.088509 Oct 28 09:50:33.704638 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 284/560] 10.222.0.52 () {60 vars in 1278 bytes} [Fri Oct 28 09:50:33 2022] POST /compute/v2.1/servers/91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:50:33.719517 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-928b420e-0d80-47e0-83ab-0f70b3d9d599 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:33.720669 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-928b420e-0d80-47e0-83ab-0f70b3d9d599 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] [instance: 91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:50:33.729132 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-928b420e-0d80-47e0-83ab-0f70b3d9d599 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:33.729633 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-928b420e-0d80-47e0-83ab-0f70b3d9d599 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:33.730071 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-928b420e-0d80-47e0-83ab-0f70b3d9d599 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:33.730779 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-928b420e-0d80-47e0-83ab-0f70b3d9d599 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:33.731279 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-928b420e-0d80-47e0-83ab-0f70b3d9d599 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:33.731701 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-928b420e-0d80-47e0-83ab-0f70b3d9d599 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:33.870012 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-928b420e-0d80-47e0-83ab-0f70b3d9d599 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bee2d5f599642788c32e0d8b8338c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e7d531c0f4a33a869309af965e3e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:33.874161 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG dbcounter [-] [127033] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=127033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:50:33.879320 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-928b420e-0d80-47e0-83ab-0f70b3d9d599 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] 10.222.0.52 "GET /compute/v2.1/servers/91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1" status: 200 len: 1662 microversion: 2.1 time: 0.168261 Oct 28 09:50:33.884634 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 277/561] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:50:33 2022] GET /compute/v2.1/servers/91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1 => generated 1662 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:34.907280 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-9c93bf93-bb5e-4a06-8fe5-cc02679a5b85 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:34.908823 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-9c93bf93-bb5e-4a06-8fe5-cc02679a5b85 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] [instance: 91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:50:34.915304 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-9c93bf93-bb5e-4a06-8fe5-cc02679a5b85 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:34.916038 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-9c93bf93-bb5e-4a06-8fe5-cc02679a5b85 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:34.916660 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-9c93bf93-bb5e-4a06-8fe5-cc02679a5b85 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:34.917366 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-9c93bf93-bb5e-4a06-8fe5-cc02679a5b85 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:34.917866 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-9c93bf93-bb5e-4a06-8fe5-cc02679a5b85 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:34.918367 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-9c93bf93-bb5e-4a06-8fe5-cc02679a5b85 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:35.066962 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-9c93bf93-bb5e-4a06-8fe5-cc02679a5b85 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bee2d5f599642788c32e0d8b8338c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e7d531c0f4a33a869309af965e3e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:35.076219 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-9c93bf93-bb5e-4a06-8fe5-cc02679a5b85 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] 10.222.0.52 "GET /compute/v2.1/servers/91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1" status: 200 len: 1662 microversion: 2.1 time: 0.174167 Oct 28 09:50:35.077005 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 285/562] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:50:34 2022] GET /compute/v2.1/servers/91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1 => generated 1662 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:36.100086 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-a0138117-2f04-4ea5-a994-2c07e2de6d8a tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:36.100690 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-a0138117-2f04-4ea5-a994-2c07e2de6d8a tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] [instance: 91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:50:36.108731 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-a0138117-2f04-4ea5-a994-2c07e2de6d8a tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:36.109258 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-a0138117-2f04-4ea5-a994-2c07e2de6d8a tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:36.109688 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-a0138117-2f04-4ea5-a994-2c07e2de6d8a tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:36.110626 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-a0138117-2f04-4ea5-a994-2c07e2de6d8a tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:36.111135 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-a0138117-2f04-4ea5-a994-2c07e2de6d8a tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:36.111485 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-a0138117-2f04-4ea5-a994-2c07e2de6d8a tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:36.238173 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-a0138117-2f04-4ea5-a994-2c07e2de6d8a tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bee2d5f599642788c32e0d8b8338c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e7d531c0f4a33a869309af965e3e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:36.246115 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-a0138117-2f04-4ea5-a994-2c07e2de6d8a tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] 10.222.0.52 "GET /compute/v2.1/servers/91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1" status: 200 len: 1666 microversion: 2.1 time: 0.150601 Oct 28 09:50:36.247310 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 278/563] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:50:36 2022] GET /compute/v2.1/servers/91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1 => generated 1666 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:40.011853 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-452248b6-fbdb-4562-9f9c-47f2f76cc98a tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "362a8b41-a268-4a64-80d2-ceea413a0440"}} {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:50:40.014902 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-452248b6-fbdb-4562-9f9c-47f2f76cc98a tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: e6ddb7f9-7854-4aa1-a174-2048b9a40431] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:50:40.021027 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-452248b6-fbdb-4562-9f9c-47f2f76cc98a tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:40.021503 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-452248b6-fbdb-4562-9f9c-47f2f76cc98a tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:40.021931 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-452248b6-fbdb-4562-9f9c-47f2f76cc98a tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:40.022619 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-452248b6-fbdb-4562-9f9c-47f2f76cc98a tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:40.023066 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-452248b6-fbdb-4562-9f9c-47f2f76cc98a tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:40.023486 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-452248b6-fbdb-4562-9f9c-47f2f76cc98a tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:40.292378 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-452248b6-fbdb-4562-9f9c-47f2f76cc98a tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] 10.222.0.52 "POST /compute/v2.1/servers/e6ddb7f9-7854-4aa1-a174-2048b9a40431/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.285522 Oct 28 09:50:40.293712 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 286/564] 10.222.0.52 () {60 vars in 1323 bytes} [Fri Oct 28 09:50:40 2022] POST /compute/v2.1/servers/e6ddb7f9-7854-4aa1-a174-2048b9a40431/os-volume_attachments => generated 194 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:50:42.536003 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-01263ff7-f8cb-4e8f-b6e8-78dc69e320d4 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:50:42.538299 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-01263ff7-f8cb-4e8f-b6e8-78dc69e320d4 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: e6ddb7f9-7854-4aa1-a174-2048b9a40431] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:50:42.541377 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 09:50:42.541515 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Fri Oct 28 09:50:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e6ddb7f9-7854-4aa1-a174-2048b9a40431/action (ip 10.222.0.52) !!! Oct 28 09:50:42.542496 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG dbcounter [-] [127033] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=127033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:50:42.550646 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-01263ff7-f8cb-4e8f-b6e8-78dc69e320d4 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:42.551136 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-01263ff7-f8cb-4e8f-b6e8-78dc69e320d4 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:42.551574 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-01263ff7-f8cb-4e8f-b6e8-78dc69e320d4 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:42.552307 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-01263ff7-f8cb-4e8f-b6e8-78dc69e320d4 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:42.552766 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-01263ff7-f8cb-4e8f-b6e8-78dc69e320d4 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:42.553193 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-01263ff7-f8cb-4e8f-b6e8-78dc69e320d4 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:42.577893 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.objects.instance [None req-01263ff7-f8cb-4e8f-b6e8-78dc69e320d4 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lazy-loading 'flavor' on Instance uuid e6ddb7f9-7854-4aa1-a174-2048b9a40431 {{(pid=127033) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:50:42.702787 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-01263ff7-f8cb-4e8f-b6e8-78dc69e320d4 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] 10.222.0.52 "POST /compute/v2.1/servers/e6ddb7f9-7854-4aa1-a174-2048b9a40431/action" status: 200 len: 32 microversion: 2.1 time: 0.170700 Oct 28 09:50:42.703400 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 279/565] 10.222.0.52 () {60 vars in 1278 bytes} [Fri Oct 28 09:50:42 2022] POST /compute/v2.1/servers/e6ddb7f9-7854-4aa1-a174-2048b9a40431/action => generated 32 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 09:50:42.714317 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-3c14f8e8-19a6-4c2c-b49b-30f5092b533e tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:42.715017 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-3c14f8e8-19a6-4c2c-b49b-30f5092b533e tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: e6ddb7f9-7854-4aa1-a174-2048b9a40431] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:50:42.717473 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG dbcounter [-] [127032] Writing DB stats nova_api:SELECT=31 {{(pid=127032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:50:42.723673 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-3c14f8e8-19a6-4c2c-b49b-30f5092b533e tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:42.724300 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-3c14f8e8-19a6-4c2c-b49b-30f5092b533e tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:42.724739 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-3c14f8e8-19a6-4c2c-b49b-30f5092b533e tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:42.725543 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-3c14f8e8-19a6-4c2c-b49b-30f5092b533e tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:42.726016 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-3c14f8e8-19a6-4c2c-b49b-30f5092b533e tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:42.726930 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-3c14f8e8-19a6-4c2c-b49b-30f5092b533e tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:42.729415 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG dbcounter [-] [127032] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=127032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:50:42.866802 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-3c14f8e8-19a6-4c2c-b49b-30f5092b533e tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe6eb38e8df492daaef5755ddea7773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234f69f21d7a456a9ab6a86c4ac2ede2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:42.876473 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-3c14f8e8-19a6-4c2c-b49b-30f5092b533e tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] 10.222.0.52 "GET /compute/v2.1/servers/e6ddb7f9-7854-4aa1-a174-2048b9a40431" status: 200 len: 1736 microversion: 2.1 time: 0.167108 Oct 28 09:50:42.877444 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 287/566] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:50:42 2022] GET /compute/v2.1/servers/e6ddb7f9-7854-4aa1-a174-2048b9a40431 => generated 1736 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:43.900816 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-45919c7c-6519-475d-b608-d88962bf4935 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:43.901542 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-45919c7c-6519-475d-b608-d88962bf4935 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: e6ddb7f9-7854-4aa1-a174-2048b9a40431] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:50:43.908383 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-45919c7c-6519-475d-b608-d88962bf4935 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:43.908905 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-45919c7c-6519-475d-b608-d88962bf4935 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:43.909342 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-45919c7c-6519-475d-b608-d88962bf4935 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:43.910040 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-45919c7c-6519-475d-b608-d88962bf4935 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:43.910496 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-45919c7c-6519-475d-b608-d88962bf4935 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:43.910921 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-45919c7c-6519-475d-b608-d88962bf4935 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:44.039340 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-45919c7c-6519-475d-b608-d88962bf4935 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe6eb38e8df492daaef5755ddea7773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234f69f21d7a456a9ab6a86c4ac2ede2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:44.048902 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-45919c7c-6519-475d-b608-d88962bf4935 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] 10.222.0.52 "GET /compute/v2.1/servers/e6ddb7f9-7854-4aa1-a174-2048b9a40431" status: 200 len: 1736 microversion: 2.1 time: 0.152987 Oct 28 09:50:44.049482 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 280/567] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:50:43 2022] GET /compute/v2.1/servers/e6ddb7f9-7854-4aa1-a174-2048b9a40431 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:45.072420 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-9c7a0596-b7cb-41cc-90c7-c31db98bcabf tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:45.073033 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-9c7a0596-b7cb-41cc-90c7-c31db98bcabf tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: e6ddb7f9-7854-4aa1-a174-2048b9a40431] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:50:45.080007 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-9c7a0596-b7cb-41cc-90c7-c31db98bcabf tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:45.080489 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-9c7a0596-b7cb-41cc-90c7-c31db98bcabf tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:45.080917 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-9c7a0596-b7cb-41cc-90c7-c31db98bcabf tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:45.081600 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-9c7a0596-b7cb-41cc-90c7-c31db98bcabf tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:45.082051 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-9c7a0596-b7cb-41cc-90c7-c31db98bcabf tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:45.082471 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-9c7a0596-b7cb-41cc-90c7-c31db98bcabf tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:45.208728 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-9c7a0596-b7cb-41cc-90c7-c31db98bcabf tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe6eb38e8df492daaef5755ddea7773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234f69f21d7a456a9ab6a86c4ac2ede2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:45.217564 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-9c7a0596-b7cb-41cc-90c7-c31db98bcabf tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] 10.222.0.52 "GET /compute/v2.1/servers/e6ddb7f9-7854-4aa1-a174-2048b9a40431" status: 200 len: 1736 microversion: 2.1 time: 0.148464 Oct 28 09:50:45.218127 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 288/568] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:50:45 2022] GET /compute/v2.1/servers/e6ddb7f9-7854-4aa1-a174-2048b9a40431 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:46.242176 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-1e8d2d89-72c6-4082-8fb8-fbd61acc449b tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:46.242793 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-1e8d2d89-72c6-4082-8fb8-fbd61acc449b tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: e6ddb7f9-7854-4aa1-a174-2048b9a40431] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:50:46.249852 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-1e8d2d89-72c6-4082-8fb8-fbd61acc449b tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:46.250350 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-1e8d2d89-72c6-4082-8fb8-fbd61acc449b tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:46.250796 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-1e8d2d89-72c6-4082-8fb8-fbd61acc449b tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:46.251511 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-1e8d2d89-72c6-4082-8fb8-fbd61acc449b tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:46.252015 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-1e8d2d89-72c6-4082-8fb8-fbd61acc449b tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:46.252462 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-1e8d2d89-72c6-4082-8fb8-fbd61acc449b tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:46.398458 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-1e8d2d89-72c6-4082-8fb8-fbd61acc449b tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe6eb38e8df492daaef5755ddea7773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234f69f21d7a456a9ab6a86c4ac2ede2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:46.408011 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-1e8d2d89-72c6-4082-8fb8-fbd61acc449b tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] 10.222.0.52 "GET /compute/v2.1/servers/e6ddb7f9-7854-4aa1-a174-2048b9a40431" status: 200 len: 1736 microversion: 2.1 time: 0.169804 Oct 28 09:50:46.408710 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 281/569] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:50:46 2022] GET /compute/v2.1/servers/e6ddb7f9-7854-4aa1-a174-2048b9a40431 => generated 1736 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:47.432022 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-52c2c579-a93b-4fec-858d-d8f2502716e2 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:47.432623 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-52c2c579-a93b-4fec-858d-d8f2502716e2 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: e6ddb7f9-7854-4aa1-a174-2048b9a40431] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:50:47.439525 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-52c2c579-a93b-4fec-858d-d8f2502716e2 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:47.440038 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-52c2c579-a93b-4fec-858d-d8f2502716e2 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:47.440473 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-52c2c579-a93b-4fec-858d-d8f2502716e2 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:47.441156 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-52c2c579-a93b-4fec-858d-d8f2502716e2 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:47.441606 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-52c2c579-a93b-4fec-858d-d8f2502716e2 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:47.442029 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-52c2c579-a93b-4fec-858d-d8f2502716e2 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:47.578317 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-52c2c579-a93b-4fec-858d-d8f2502716e2 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe6eb38e8df492daaef5755ddea7773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234f69f21d7a456a9ab6a86c4ac2ede2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:47.586376 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-52c2c579-a93b-4fec-858d-d8f2502716e2 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] 10.222.0.52 "GET /compute/v2.1/servers/e6ddb7f9-7854-4aa1-a174-2048b9a40431" status: 200 len: 1736 microversion: 2.1 time: 0.158424 Oct 28 09:50:47.586936 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 289/570] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:50:47 2022] GET /compute/v2.1/servers/e6ddb7f9-7854-4aa1-a174-2048b9a40431 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:50:48.610739 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-6e8c13e2-c9a3-48db-b605-60b7424fc62c tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:48.611349 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-6e8c13e2-c9a3-48db-b605-60b7424fc62c tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: e6ddb7f9-7854-4aa1-a174-2048b9a40431] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:50:48.617809 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-6e8c13e2-c9a3-48db-b605-60b7424fc62c tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:48.618295 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-6e8c13e2-c9a3-48db-b605-60b7424fc62c tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:48.618732 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-6e8c13e2-c9a3-48db-b605-60b7424fc62c tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:48.619451 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-6e8c13e2-c9a3-48db-b605-60b7424fc62c tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:48.619940 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-6e8c13e2-c9a3-48db-b605-60b7424fc62c tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:48.620366 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-6e8c13e2-c9a3-48db-b605-60b7424fc62c tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:48.746553 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-6e8c13e2-c9a3-48db-b605-60b7424fc62c tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe6eb38e8df492daaef5755ddea7773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234f69f21d7a456a9ab6a86c4ac2ede2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:48.754660 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-6e8c13e2-c9a3-48db-b605-60b7424fc62c tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] 10.222.0.52 "GET /compute/v2.1/servers/e6ddb7f9-7854-4aa1-a174-2048b9a40431" status: 200 len: 1736 microversion: 2.1 time: 0.148722 Oct 28 09:50:48.755220 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 282/571] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:50:48 2022] GET /compute/v2.1/servers/e6ddb7f9-7854-4aa1-a174-2048b9a40431 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:49.778719 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-ee668fa1-6dc3-44d4-8dcb-5956917d554a tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:49.779319 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-ee668fa1-6dc3-44d4-8dcb-5956917d554a tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: e6ddb7f9-7854-4aa1-a174-2048b9a40431] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:50:49.786666 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ee668fa1-6dc3-44d4-8dcb-5956917d554a tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:49.787143 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ee668fa1-6dc3-44d4-8dcb-5956917d554a tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:49.787570 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ee668fa1-6dc3-44d4-8dcb-5956917d554a tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:49.788287 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ee668fa1-6dc3-44d4-8dcb-5956917d554a tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:49.788733 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ee668fa1-6dc3-44d4-8dcb-5956917d554a tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:49.789146 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ee668fa1-6dc3-44d4-8dcb-5956917d554a tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:49.918325 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-ee668fa1-6dc3-44d4-8dcb-5956917d554a tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe6eb38e8df492daaef5755ddea7773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234f69f21d7a456a9ab6a86c4ac2ede2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:49.926606 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-ee668fa1-6dc3-44d4-8dcb-5956917d554a tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] 10.222.0.52 "GET /compute/v2.1/servers/e6ddb7f9-7854-4aa1-a174-2048b9a40431" status: 200 len: 1736 microversion: 2.1 time: 0.151880 Oct 28 09:50:49.927170 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 290/572] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:50:49 2022] GET /compute/v2.1/servers/e6ddb7f9-7854-4aa1-a174-2048b9a40431 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:50.950554 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-4ddbd6fd-23fb-4bdb-80f9-f9e33bfc2389 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:50.951188 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-4ddbd6fd-23fb-4bdb-80f9-f9e33bfc2389 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: e6ddb7f9-7854-4aa1-a174-2048b9a40431] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:50:50.958174 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-4ddbd6fd-23fb-4bdb-80f9-f9e33bfc2389 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:50.958670 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-4ddbd6fd-23fb-4bdb-80f9-f9e33bfc2389 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:50.959101 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-4ddbd6fd-23fb-4bdb-80f9-f9e33bfc2389 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:50.959897 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-4ddbd6fd-23fb-4bdb-80f9-f9e33bfc2389 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:50.960402 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-4ddbd6fd-23fb-4bdb-80f9-f9e33bfc2389 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:50.960826 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-4ddbd6fd-23fb-4bdb-80f9-f9e33bfc2389 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:51.091880 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-4ddbd6fd-23fb-4bdb-80f9-f9e33bfc2389 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe6eb38e8df492daaef5755ddea7773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234f69f21d7a456a9ab6a86c4ac2ede2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:51.100917 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-4ddbd6fd-23fb-4bdb-80f9-f9e33bfc2389 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] 10.222.0.52 "GET /compute/v2.1/servers/e6ddb7f9-7854-4aa1-a174-2048b9a40431" status: 200 len: 1736 microversion: 2.1 time: 0.154357 Oct 28 09:50:51.101484 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 283/573] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:50:50 2022] GET /compute/v2.1/servers/e6ddb7f9-7854-4aa1-a174-2048b9a40431 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:52.125726 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-ea188eba-4464-44e1-ac2d-7b9b3bf9617f tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:52.126608 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-ea188eba-4464-44e1-ac2d-7b9b3bf9617f tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: e6ddb7f9-7854-4aa1-a174-2048b9a40431] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:50:52.133110 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ea188eba-4464-44e1-ac2d-7b9b3bf9617f tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:52.133607 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ea188eba-4464-44e1-ac2d-7b9b3bf9617f tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:52.134047 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ea188eba-4464-44e1-ac2d-7b9b3bf9617f tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:52.134756 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ea188eba-4464-44e1-ac2d-7b9b3bf9617f tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:52.135216 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ea188eba-4464-44e1-ac2d-7b9b3bf9617f tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:52.135635 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ea188eba-4464-44e1-ac2d-7b9b3bf9617f tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:52.264076 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-ea188eba-4464-44e1-ac2d-7b9b3bf9617f tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe6eb38e8df492daaef5755ddea7773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234f69f21d7a456a9ab6a86c4ac2ede2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:52.272892 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-ea188eba-4464-44e1-ac2d-7b9b3bf9617f tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] 10.222.0.52 "GET /compute/v2.1/servers/e6ddb7f9-7854-4aa1-a174-2048b9a40431" status: 200 len: 1736 microversion: 2.1 time: 0.151700 Oct 28 09:50:52.273459 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 291/574] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:50:52 2022] GET /compute/v2.1/servers/e6ddb7f9-7854-4aa1-a174-2048b9a40431 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:53.296393 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-0c30c1df-85b1-48ed-87a7-4d057790362c tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:53.297000 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-0c30c1df-85b1-48ed-87a7-4d057790362c tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: e6ddb7f9-7854-4aa1-a174-2048b9a40431] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:50:53.303683 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-0c30c1df-85b1-48ed-87a7-4d057790362c tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:53.304205 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-0c30c1df-85b1-48ed-87a7-4d057790362c tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:53.304644 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-0c30c1df-85b1-48ed-87a7-4d057790362c tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:53.305335 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-0c30c1df-85b1-48ed-87a7-4d057790362c tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:53.305791 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-0c30c1df-85b1-48ed-87a7-4d057790362c tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:53.306219 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-0c30c1df-85b1-48ed-87a7-4d057790362c tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:53.442879 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-0c30c1df-85b1-48ed-87a7-4d057790362c tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe6eb38e8df492daaef5755ddea7773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234f69f21d7a456a9ab6a86c4ac2ede2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:53.451062 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-0c30c1df-85b1-48ed-87a7-4d057790362c tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] 10.222.0.52 "GET /compute/v2.1/servers/e6ddb7f9-7854-4aa1-a174-2048b9a40431" status: 200 len: 1736 microversion: 2.1 time: 0.158889 Oct 28 09:50:53.451614 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 284/575] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:50:53 2022] GET /compute/v2.1/servers/e6ddb7f9-7854-4aa1-a174-2048b9a40431 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:54.476561 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-29b95074-504b-4519-9c1b-9d4c4e0abfca tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:54.477368 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-29b95074-504b-4519-9c1b-9d4c4e0abfca tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: e6ddb7f9-7854-4aa1-a174-2048b9a40431] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:50:54.483777 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-29b95074-504b-4519-9c1b-9d4c4e0abfca tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:54.484265 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-29b95074-504b-4519-9c1b-9d4c4e0abfca tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:54.484701 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-29b95074-504b-4519-9c1b-9d4c4e0abfca tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:54.485396 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-29b95074-504b-4519-9c1b-9d4c4e0abfca tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:54.486120 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-29b95074-504b-4519-9c1b-9d4c4e0abfca tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:54.486543 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-29b95074-504b-4519-9c1b-9d4c4e0abfca tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:54.614407 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-29b95074-504b-4519-9c1b-9d4c4e0abfca tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe6eb38e8df492daaef5755ddea7773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234f69f21d7a456a9ab6a86c4ac2ede2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:54.622608 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-29b95074-504b-4519-9c1b-9d4c4e0abfca tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] 10.222.0.52 "GET /compute/v2.1/servers/e6ddb7f9-7854-4aa1-a174-2048b9a40431" status: 200 len: 1736 microversion: 2.1 time: 0.149946 Oct 28 09:50:54.623176 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 292/576] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:50:54 2022] GET /compute/v2.1/servers/e6ddb7f9-7854-4aa1-a174-2048b9a40431 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:55.646839 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-72c4f28d-9deb-4326-bdbc-dc468aa336ce tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:55.647438 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-72c4f28d-9deb-4326-bdbc-dc468aa336ce tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: e6ddb7f9-7854-4aa1-a174-2048b9a40431] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:50:55.653955 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-72c4f28d-9deb-4326-bdbc-dc468aa336ce tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:55.654559 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-72c4f28d-9deb-4326-bdbc-dc468aa336ce tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:55.654996 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-72c4f28d-9deb-4326-bdbc-dc468aa336ce tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:55.655691 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-72c4f28d-9deb-4326-bdbc-dc468aa336ce tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:55.656216 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-72c4f28d-9deb-4326-bdbc-dc468aa336ce tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:55.656638 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-72c4f28d-9deb-4326-bdbc-dc468aa336ce tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:55.788795 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-72c4f28d-9deb-4326-bdbc-dc468aa336ce tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe6eb38e8df492daaef5755ddea7773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234f69f21d7a456a9ab6a86c4ac2ede2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:55.796983 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-72c4f28d-9deb-4326-bdbc-dc468aa336ce tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] 10.222.0.52 "GET /compute/v2.1/servers/e6ddb7f9-7854-4aa1-a174-2048b9a40431" status: 200 len: 1736 microversion: 2.1 time: 0.154466 Oct 28 09:50:55.797552 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 285/577] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:50:55 2022] GET /compute/v2.1/servers/e6ddb7f9-7854-4aa1-a174-2048b9a40431 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:56.820343 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-a0aa465d-c854-466a-b13c-f42929c08242 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:56.820946 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-a0aa465d-c854-466a-b13c-f42929c08242 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: e6ddb7f9-7854-4aa1-a174-2048b9a40431] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:50:56.827470 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-a0aa465d-c854-466a-b13c-f42929c08242 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:56.827994 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-a0aa465d-c854-466a-b13c-f42929c08242 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:56.828435 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-a0aa465d-c854-466a-b13c-f42929c08242 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:56.829131 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-a0aa465d-c854-466a-b13c-f42929c08242 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:56.829587 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-a0aa465d-c854-466a-b13c-f42929c08242 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:56.830015 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-a0aa465d-c854-466a-b13c-f42929c08242 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:56.957142 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-a0aa465d-c854-466a-b13c-f42929c08242 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe6eb38e8df492daaef5755ddea7773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234f69f21d7a456a9ab6a86c4ac2ede2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:56.965288 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-a0aa465d-c854-466a-b13c-f42929c08242 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] 10.222.0.52 "GET /compute/v2.1/servers/e6ddb7f9-7854-4aa1-a174-2048b9a40431" status: 200 len: 1736 microversion: 2.1 time: 0.148747 Oct 28 09:50:56.965799 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 293/578] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:50:56 2022] GET /compute/v2.1/servers/e6ddb7f9-7854-4aa1-a174-2048b9a40431 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:57.996582 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-504d416a-13e4-43a9-83bb-71ca95d0e0e3 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:57.997172 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-504d416a-13e4-43a9-83bb-71ca95d0e0e3 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: e6ddb7f9-7854-4aa1-a174-2048b9a40431] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:50:58.003630 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-504d416a-13e4-43a9-83bb-71ca95d0e0e3 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:58.004148 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-504d416a-13e4-43a9-83bb-71ca95d0e0e3 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:58.004582 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-504d416a-13e4-43a9-83bb-71ca95d0e0e3 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:58.005271 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-504d416a-13e4-43a9-83bb-71ca95d0e0e3 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:58.005727 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-504d416a-13e4-43a9-83bb-71ca95d0e0e3 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:58.006181 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-504d416a-13e4-43a9-83bb-71ca95d0e0e3 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:58.133801 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-504d416a-13e4-43a9-83bb-71ca95d0e0e3 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe6eb38e8df492daaef5755ddea7773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234f69f21d7a456a9ab6a86c4ac2ede2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:58.142114 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-504d416a-13e4-43a9-83bb-71ca95d0e0e3 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] 10.222.0.52 "GET /compute/v2.1/servers/e6ddb7f9-7854-4aa1-a174-2048b9a40431" status: 200 len: 1716 microversion: 2.1 time: 0.149382 Oct 28 09:50:58.142687 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 286/579] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:50:57 2022] GET /compute/v2.1/servers/e6ddb7f9-7854-4aa1-a174-2048b9a40431 => generated 1716 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:58.248574 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-538da6bc-c43e-4953-ad08-8d929c8c0a21 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:58.249066 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-538da6bc-c43e-4953-ad08-8d929c8c0a21 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: e6ddb7f9-7854-4aa1-a174-2048b9a40431] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:50:58.255959 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-538da6bc-c43e-4953-ad08-8d929c8c0a21 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:58.256442 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-538da6bc-c43e-4953-ad08-8d929c8c0a21 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:58.256882 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-538da6bc-c43e-4953-ad08-8d929c8c0a21 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:58.257566 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-538da6bc-c43e-4953-ad08-8d929c8c0a21 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:58.258024 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-538da6bc-c43e-4953-ad08-8d929c8c0a21 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:58.258452 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-538da6bc-c43e-4953-ad08-8d929c8c0a21 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:58.337727 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.wsgi [None req-538da6bc-c43e-4953-ad08-8d929c8c0a21 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] HTTP exception thrown: Cannot 'detach_volume' instance e6ddb7f9-7854-4aa1-a174-2048b9a40431 while it is in vm_state rescued Oct 28 09:50:58.339657 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-538da6bc-c43e-4953-ad08-8d929c8c0a21 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Request method failure captured: Oct 28 09:50:58.339657 dv-cinder-zed-3-smb devstack@n-api.service[127032]: request: DELETE /compute/v2.1/servers/e6ddb7f9-7854-4aa1-a174-2048b9a40431/os-volume_attachments/362a8b41-a268-4a64-80d2-ceea413a0440 HTTP/1.1 Oct 28 09:50:58.339657 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Accept: application/json Oct 28 09:50:58.339657 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Accept-Encoding: identity Oct 28 09:50:58.339657 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Connection: close Oct 28 09:50:58.339657 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Content-Length: 0 Oct 28 09:50:58.339657 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Content-Type: application/json Oct 28 09:50:58.339657 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Host: 10.222.0.52 Oct 28 09:50:58.339657 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Openstack-System-Scope: None Oct 28 09:50:58.339657 dv-cinder-zed-3-smb devstack@n-api.service[127032]: User-Agent: python-urllib3/1.26.12 Oct 28 09:50:58.339657 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Auth-Token: gAAAAABjW6UMBLZAcB4ofCUEvyoCWt-nTaXzdGXaOtWjwHccK7VrtFAzPPGWsQagqFaH1IBUrfHYI_AtqGoeSDCkxIRD0lzPZ7kumCvA3AUFB0eRrG8vOtKEHyKYUVg_hZG8huan0rPnrbQu2YqOny3faW5JsiVxHZMfNsP73PBj_XjtK1wa1N8 Oct 28 09:50:58.339657 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Domain-Id: None Oct 28 09:50:58.339657 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Domain-Name: None Oct 28 09:50:58.339657 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Identity-Status: Confirmed Oct 28 09:50:58.339657 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Is-Admin-Project: True Oct 28 09:50:58.339657 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Project-Domain-Id: default Oct 28 09:50:58.339657 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Project-Domain-Name: Default Oct 28 09:50:58.339657 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Project-Id: 234f69f21d7a456a9ab6a86c4ac2ede2 Oct 28 09:50:58.339657 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1058371291 Oct 28 09:50:58.339657 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Role: reader,member Oct 28 09:50:58.339657 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Roles: reader,member Oct 28 09:50:58.341205 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_234f69f21d7a456a9ab6a86c4ac2ede2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/234f69f21d7a456a9ab6a86c4ac2ede2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/234f69f21d7a456a9ab6a86c4ac2ede2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/234f69f21d7a456a9ab6a86c4ac2ede2"}]}] Oct 28 09:50:58.341205 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1058371291 Oct 28 09:50:58.341205 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Tenant-Id: 234f69f21d7a456a9ab6a86c4ac2ede2 Oct 28 09:50:58.341205 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1058371291 Oct 28 09:50:58.341205 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-User: tempest-ServerRescueNegativeTestJSON-1058371291-project Oct 28 09:50:58.341205 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-User-Domain-Id: default Oct 28 09:50:58.341205 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-User-Domain-Name: Default Oct 28 09:50:58.341205 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-User-Id: cfe6eb38e8df492daaef5755ddea7773 Oct 28 09:50:58.341205 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1058371291-project Oct 28 09:50:58.341205 dv-cinder-zed-3-smb devstack@n-api.service[127032]: method: > Oct 28 09:50:58.341205 dv-cinder-zed-3-smb devstack@n-api.service[127032]: exception: Cannot 'detach_volume' instance e6ddb7f9-7854-4aa1-a174-2048b9a40431 while it is in vm_state rescued Oct 28 09:50:58.341889 dv-cinder-zed-3-smb devstack@n-api.service[127032]: action_args: {'server_id': 'e6ddb7f9-7854-4aa1-a174-2048b9a40431', 'id': '362a8b41-a268-4a64-80d2-ceea413a0440'} Oct 28 09:50:58.341889 dv-cinder-zed-3-smb devstack@n-api.service[127032]: {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:50:58.341889 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:50:58.341889 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Oct 28 09:50:58.341889 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Oct 28 09:50:58.341889 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 28 09:50:58.341889 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 09:50:58.341889 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 28 09:50:58.341889 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 28 09:50:58.341889 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e6ddb7f9-7854-4aa1-a174-2048b9a40431 in vm_state rescued. Cannot detach_volume while the instance is in this state. Oct 28 09:50:58.341889 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Oct 28 09:50:58.341889 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:50:58.341889 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Oct 28 09:50:58.341889 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:50:58.341889 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:50:58.341889 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:50:58.341889 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:50:58.341889 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:50:58.341889 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:50:58.341889 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:50:58.343128 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Oct 28 09:50:58.343128 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 28 09:50:58.343128 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 28 09:50:58.343128 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 28 09:50:58.343128 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance e6ddb7f9-7854-4aa1-a174-2048b9a40431 while it is in vm_state rescued Oct 28 09:50:58.343128 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Oct 28 09:50:58.343128 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:50:58.343128 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Oct 28 09:50:58.343128 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:50:58.343128 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:50:58.343128 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:50:58.343128 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:50:58.343128 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:50:58.343128 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance e6ddb7f9-7854-4aa1-a174-2048b9a40431 while it is in vm_state rescued Oct 28 09:50:58.343128 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Oct 28 09:50:58.343128 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-538da6bc-c43e-4953-ad08-8d929c8c0a21 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Returning 409 to user: Cannot 'detach_volume' instance e6ddb7f9-7854-4aa1-a174-2048b9a40431 while it is in vm_state rescued {{(pid=127032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:50:58.344266 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-538da6bc-c43e-4953-ad08-8d929c8c0a21 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] 10.222.0.52 "DELETE /compute/v2.1/servers/e6ddb7f9-7854-4aa1-a174-2048b9a40431/os-volume_attachments/362a8b41-a268-4a64-80d2-ceea413a0440" status: 409 len: 152 microversion: 2.1 time: 0.096649 Oct 28 09:50:58.344266 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 294/580] 10.222.0.52 () {58 vars in 1416 bytes} [Fri Oct 28 09:50:58 2022] DELETE /compute/v2.1/servers/e6ddb7f9-7854-4aa1-a174-2048b9a40431/os-volume_attachments/362a8b41-a268-4a64-80d2-ceea413a0440 => generated 152 bytes in 98 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 28 09:50:58.350087 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-b91b82fd-8676-4e64-bef5-97c03a1d1c4b tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:50:58.350621 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-b91b82fd-8676-4e64-bef5-97c03a1d1c4b tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: e6ddb7f9-7854-4aa1-a174-2048b9a40431] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:50:58.356570 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-b91b82fd-8676-4e64-bef5-97c03a1d1c4b tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:58.357058 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-b91b82fd-8676-4e64-bef5-97c03a1d1c4b tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:58.357494 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-b91b82fd-8676-4e64-bef5-97c03a1d1c4b tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:58.358183 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-b91b82fd-8676-4e64-bef5-97c03a1d1c4b tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:58.358635 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-b91b82fd-8676-4e64-bef5-97c03a1d1c4b tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:58.359061 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-b91b82fd-8676-4e64-bef5-97c03a1d1c4b tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:58.424765 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-b91b82fd-8676-4e64-bef5-97c03a1d1c4b tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] 10.222.0.52 "POST /compute/v2.1/servers/e6ddb7f9-7854-4aa1-a174-2048b9a40431/action" status: 202 len: 0 microversion: 2.1 time: 0.078300 Oct 28 09:50:58.428487 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 287/581] 10.222.0.52 () {60 vars in 1278 bytes} [Fri Oct 28 09:50:58 2022] POST /compute/v2.1/servers/e6ddb7f9-7854-4aa1-a174-2048b9a40431/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:50:58.433698 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-a60e2e9b-7340-497b-a20e-7f3669de9cec tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:58.434310 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-a60e2e9b-7340-497b-a20e-7f3669de9cec tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: e6ddb7f9-7854-4aa1-a174-2048b9a40431] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:50:58.441491 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-a60e2e9b-7340-497b-a20e-7f3669de9cec tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:58.441985 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-a60e2e9b-7340-497b-a20e-7f3669de9cec tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:58.442458 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-a60e2e9b-7340-497b-a20e-7f3669de9cec tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:58.443126 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-a60e2e9b-7340-497b-a20e-7f3669de9cec tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:58.443580 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-a60e2e9b-7340-497b-a20e-7f3669de9cec tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:58.444034 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-a60e2e9b-7340-497b-a20e-7f3669de9cec tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:58.577597 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-a60e2e9b-7340-497b-a20e-7f3669de9cec tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe6eb38e8df492daaef5755ddea7773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234f69f21d7a456a9ab6a86c4ac2ede2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:58.588102 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-a60e2e9b-7340-497b-a20e-7f3669de9cec tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] 10.222.0.52 "GET /compute/v2.1/servers/e6ddb7f9-7854-4aa1-a174-2048b9a40431" status: 200 len: 1724 microversion: 2.1 time: 0.158060 Oct 28 09:50:58.589920 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 295/582] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:50:58 2022] GET /compute/v2.1/servers/e6ddb7f9-7854-4aa1-a174-2048b9a40431 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:58.777582 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-75835634-f8ed-493c-854c-73826b529f06 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:58.778233 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-75835634-f8ed-493c-854c-73826b529f06 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 6869ffb6-ce4f-4a91-b8d9-7765ea56e95a] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:50:58.785005 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-75835634-f8ed-493c-854c-73826b529f06 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:58.785609 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-75835634-f8ed-493c-854c-73826b529f06 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:58.786116 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-75835634-f8ed-493c-854c-73826b529f06 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:58.786894 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-75835634-f8ed-493c-854c-73826b529f06 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:58.787429 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-75835634-f8ed-493c-854c-73826b529f06 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:58.787964 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-75835634-f8ed-493c-854c-73826b529f06 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:58.820294 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-75835634-f8ed-493c-854c-73826b529f06 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a/os-volume_attachments/523ea4ad-db65-4384-aba4-44e9532e0171" status: 200 len: 194 microversion: 2.20 time: 0.236987 Oct 28 09:50:58.820897 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 288/583] 10.222.0.52 () {60 vars in 1454 bytes} [Fri Oct 28 09:50:58 2022] GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a/os-volume_attachments/523ea4ad-db65-4384-aba4-44e9532e0171 => generated 194 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 09:50:58.893853 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-a8f2f50e-9e8b-497c-9c93-099a8f92a148 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:58.894346 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-a8f2f50e-9e8b-497c-9c93-099a8f92a148 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 6869ffb6-ce4f-4a91-b8d9-7765ea56e95a] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:50:58.900571 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-a8f2f50e-9e8b-497c-9c93-099a8f92a148 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:58.901002 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-a8f2f50e-9e8b-497c-9c93-099a8f92a148 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:58.901517 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-a8f2f50e-9e8b-497c-9c93-099a8f92a148 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:58.902329 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-a8f2f50e-9e8b-497c-9c93-099a8f92a148 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:58.902787 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-a8f2f50e-9e8b-497c-9c93-099a8f92a148 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:58.903214 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-a8f2f50e-9e8b-497c-9c93-099a8f92a148 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:58.991703 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.objects.instance [None req-a8f2f50e-9e8b-497c-9c93-099a8f92a148 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lazy-loading 'services' on Instance uuid 6869ffb6-ce4f-4a91-b8d9-7765ea56e95a {{(pid=127032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:50:59.076647 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-a8f2f50e-9e8b-497c-9c93-099a8f92a148 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "DELETE /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a/os-volume_attachments/523ea4ad-db65-4384-aba4-44e9532e0171" status: 202 len: 0 microversion: 2.20 time: 0.186758 Oct 28 09:50:59.077242 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 296/584] 10.222.0.52 () {60 vars in 1457 bytes} [Fri Oct 28 09:50:58 2022] DELETE /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a/os-volume_attachments/523ea4ad-db65-4384-aba4-44e9532e0171 => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 28 09:50:59.085864 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-3b83b72e-aac3-457a-a565-4f6c32c717bb tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:59.088197 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-3b83b72e-aac3-457a-a565-4f6c32c717bb tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 6869ffb6-ce4f-4a91-b8d9-7765ea56e95a] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:50:59.094982 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-3b83b72e-aac3-457a-a565-4f6c32c717bb tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:59.095486 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-3b83b72e-aac3-457a-a565-4f6c32c717bb tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:59.096459 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-3b83b72e-aac3-457a-a565-4f6c32c717bb tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:59.097175 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-3b83b72e-aac3-457a-a565-4f6c32c717bb tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:59.097636 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-3b83b72e-aac3-457a-a565-4f6c32c717bb tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:59.098062 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-3b83b72e-aac3-457a-a565-4f6c32c717bb tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:59.132254 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-3b83b72e-aac3-457a-a565-4f6c32c717bb tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049896 Oct 28 09:50:59.133477 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 289/585] 10.222.0.52 () {60 vars in 1343 bytes} [Fri Oct 28 09:50:59 2022] GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 09:50:59.613854 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-12a1314d-ca5c-4aea-bacd-5916885b7282 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:59.614689 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-12a1314d-ca5c-4aea-bacd-5916885b7282 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: e6ddb7f9-7854-4aa1-a174-2048b9a40431] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:50:59.620796 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-12a1314d-ca5c-4aea-bacd-5916885b7282 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:59.621278 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-12a1314d-ca5c-4aea-bacd-5916885b7282 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:59.621714 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-12a1314d-ca5c-4aea-bacd-5916885b7282 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:59.622402 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-12a1314d-ca5c-4aea-bacd-5916885b7282 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:59.622849 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-12a1314d-ca5c-4aea-bacd-5916885b7282 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:59.623268 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-12a1314d-ca5c-4aea-bacd-5916885b7282 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:59.758571 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-12a1314d-ca5c-4aea-bacd-5916885b7282 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe6eb38e8df492daaef5755ddea7773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234f69f21d7a456a9ab6a86c4ac2ede2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:59.767054 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-12a1314d-ca5c-4aea-bacd-5916885b7282 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] 10.222.0.52 "GET /compute/v2.1/servers/e6ddb7f9-7854-4aa1-a174-2048b9a40431" status: 200 len: 1724 microversion: 2.1 time: 0.158181 Oct 28 09:50:59.767659 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 297/586] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:50:59 2022] GET /compute/v2.1/servers/e6ddb7f9-7854-4aa1-a174-2048b9a40431 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:00.146128 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-3dcd6351-7cb6-413f-b577-94de52a4d623 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:00.148456 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-3dcd6351-7cb6-413f-b577-94de52a4d623 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 6869ffb6-ce4f-4a91-b8d9-7765ea56e95a] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:51:00.154986 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-3dcd6351-7cb6-413f-b577-94de52a4d623 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:00.155467 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-3dcd6351-7cb6-413f-b577-94de52a4d623 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:00.155929 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-3dcd6351-7cb6-413f-b577-94de52a4d623 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:00.156627 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-3dcd6351-7cb6-413f-b577-94de52a4d623 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:00.157083 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-3dcd6351-7cb6-413f-b577-94de52a4d623 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:00.157507 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-3dcd6351-7cb6-413f-b577-94de52a4d623 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:00.187961 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-3dcd6351-7cb6-413f-b577-94de52a4d623 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046251 Oct 28 09:51:00.188538 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 290/587] 10.222.0.52 () {60 vars in 1343 bytes} [Fri Oct 28 09:51:00 2022] GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 09:51:00.791015 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-71b8f411-5866-4db6-b932-b22d50c8faa3 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:00.791540 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-71b8f411-5866-4db6-b932-b22d50c8faa3 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: e6ddb7f9-7854-4aa1-a174-2048b9a40431] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:51:00.797909 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-71b8f411-5866-4db6-b932-b22d50c8faa3 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:00.798395 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-71b8f411-5866-4db6-b932-b22d50c8faa3 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:00.798824 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-71b8f411-5866-4db6-b932-b22d50c8faa3 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:00.799508 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-71b8f411-5866-4db6-b932-b22d50c8faa3 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:00.799993 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-71b8f411-5866-4db6-b932-b22d50c8faa3 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:00.800416 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-71b8f411-5866-4db6-b932-b22d50c8faa3 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:00.929954 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-71b8f411-5866-4db6-b932-b22d50c8faa3 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe6eb38e8df492daaef5755ddea7773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234f69f21d7a456a9ab6a86c4ac2ede2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:00.938231 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-71b8f411-5866-4db6-b932-b22d50c8faa3 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] 10.222.0.52 "GET /compute/v2.1/servers/e6ddb7f9-7854-4aa1-a174-2048b9a40431" status: 200 len: 1724 microversion: 2.1 time: 0.151147 Oct 28 09:51:00.938807 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 298/588] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:51:00 2022] GET /compute/v2.1/servers/e6ddb7f9-7854-4aa1-a174-2048b9a40431 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:01.202021 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-c2661f38-723f-40ae-8d53-f73d307f522e tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:01.204198 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-c2661f38-723f-40ae-8d53-f73d307f522e tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 6869ffb6-ce4f-4a91-b8d9-7765ea56e95a] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:51:01.211147 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-c2661f38-723f-40ae-8d53-f73d307f522e tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:01.211624 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-c2661f38-723f-40ae-8d53-f73d307f522e tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:01.212098 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-c2661f38-723f-40ae-8d53-f73d307f522e tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:01.212788 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-c2661f38-723f-40ae-8d53-f73d307f522e tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:01.213238 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-c2661f38-723f-40ae-8d53-f73d307f522e tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:01.213659 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-c2661f38-723f-40ae-8d53-f73d307f522e tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:01.230038 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG dbcounter [-] [127033] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:01.245014 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-c2661f38-723f-40ae-8d53-f73d307f522e tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047011 Oct 28 09:51:01.245573 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 291/589] 10.222.0.52 () {60 vars in 1343 bytes} [Fri Oct 28 09:51:01 2022] GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 09:51:01.960776 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-6202c537-d6a9-49c0-af6e-93045189c190 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:01.961385 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-6202c537-d6a9-49c0-af6e-93045189c190 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: e6ddb7f9-7854-4aa1-a174-2048b9a40431] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:51:01.967714 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-6202c537-d6a9-49c0-af6e-93045189c190 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:01.968230 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-6202c537-d6a9-49c0-af6e-93045189c190 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:01.968705 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-6202c537-d6a9-49c0-af6e-93045189c190 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:01.969393 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-6202c537-d6a9-49c0-af6e-93045189c190 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:01.969850 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-6202c537-d6a9-49c0-af6e-93045189c190 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:01.970273 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-6202c537-d6a9-49c0-af6e-93045189c190 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:02.098097 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-6202c537-d6a9-49c0-af6e-93045189c190 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe6eb38e8df492daaef5755ddea7773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234f69f21d7a456a9ab6a86c4ac2ede2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:02.106242 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-6202c537-d6a9-49c0-af6e-93045189c190 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] 10.222.0.52 "GET /compute/v2.1/servers/e6ddb7f9-7854-4aa1-a174-2048b9a40431" status: 200 len: 1724 microversion: 2.1 time: 0.149384 Oct 28 09:51:02.106805 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 299/590] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:51:01 2022] GET /compute/v2.1/servers/e6ddb7f9-7854-4aa1-a174-2048b9a40431 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:51:02.257859 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-c2579f22-5480-4bf5-91c9-3d7835c3a9be tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:02.260030 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-c2579f22-5480-4bf5-91c9-3d7835c3a9be tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 6869ffb6-ce4f-4a91-b8d9-7765ea56e95a] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:51:02.266373 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-c2579f22-5480-4bf5-91c9-3d7835c3a9be tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:02.266857 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-c2579f22-5480-4bf5-91c9-3d7835c3a9be tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:02.267301 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-c2579f22-5480-4bf5-91c9-3d7835c3a9be tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:02.268583 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-c2579f22-5480-4bf5-91c9-3d7835c3a9be tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:02.269039 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-c2579f22-5480-4bf5-91c9-3d7835c3a9be tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:02.269471 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-c2579f22-5480-4bf5-91c9-3d7835c3a9be tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:02.299065 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-c2579f22-5480-4bf5-91c9-3d7835c3a9be tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045326 Oct 28 09:51:02.299594 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 292/591] 10.222.0.52 () {60 vars in 1343 bytes} [Fri Oct 28 09:51:02 2022] GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 09:51:03.130617 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-3a162fa6-191a-44fc-8212-e9bedc9210e0 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:03.131249 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-3a162fa6-191a-44fc-8212-e9bedc9210e0 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: e6ddb7f9-7854-4aa1-a174-2048b9a40431] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:51:03.134137 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 09:51:03.134289 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Fri Oct 28 09:51:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e6ddb7f9-7854-4aa1-a174-2048b9a40431 (ip 10.222.0.52) !!! Oct 28 09:51:03.141161 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-3a162fa6-191a-44fc-8212-e9bedc9210e0 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:03.141667 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-3a162fa6-191a-44fc-8212-e9bedc9210e0 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:03.142084 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-3a162fa6-191a-44fc-8212-e9bedc9210e0 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:03.142780 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-3a162fa6-191a-44fc-8212-e9bedc9210e0 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:03.143259 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-3a162fa6-191a-44fc-8212-e9bedc9210e0 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:03.143691 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-3a162fa6-191a-44fc-8212-e9bedc9210e0 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:03.270271 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-3a162fa6-191a-44fc-8212-e9bedc9210e0 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe6eb38e8df492daaef5755ddea7773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234f69f21d7a456a9ab6a86c4ac2ede2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:03.278496 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-3a162fa6-191a-44fc-8212-e9bedc9210e0 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] 10.222.0.52 "GET /compute/v2.1/servers/e6ddb7f9-7854-4aa1-a174-2048b9a40431" status: 200 len: 1730 microversion: 2.1 time: 0.152312 Oct 28 09:51:03.279068 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 300/592] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:51:03 2022] GET /compute/v2.1/servers/e6ddb7f9-7854-4aa1-a174-2048b9a40431 => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:03.301677 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-910af7b6-8d8d-4890-bcb8-a931f3dba3aa tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:03.302232 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-910af7b6-8d8d-4890-bcb8-a931f3dba3aa tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: e6ddb7f9-7854-4aa1-a174-2048b9a40431] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:51:03.308972 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-910af7b6-8d8d-4890-bcb8-a931f3dba3aa tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:03.309465 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-910af7b6-8d8d-4890-bcb8-a931f3dba3aa tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:03.309938 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-910af7b6-8d8d-4890-bcb8-a931f3dba3aa tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:03.310636 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-910af7b6-8d8d-4890-bcb8-a931f3dba3aa tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:03.310936 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-17ae2ff5-a531-497b-ae66-bf9951a935d6 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:03.311095 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-910af7b6-8d8d-4890-bcb8-a931f3dba3aa tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:03.311521 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-910af7b6-8d8d-4890-bcb8-a931f3dba3aa tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:03.313198 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-17ae2ff5-a531-497b-ae66-bf9951a935d6 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 6869ffb6-ce4f-4a91-b8d9-7765ea56e95a] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:51:03.319832 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-17ae2ff5-a531-497b-ae66-bf9951a935d6 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:03.320324 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-17ae2ff5-a531-497b-ae66-bf9951a935d6 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:03.320759 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-17ae2ff5-a531-497b-ae66-bf9951a935d6 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:03.321455 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-17ae2ff5-a531-497b-ae66-bf9951a935d6 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:03.321916 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-17ae2ff5-a531-497b-ae66-bf9951a935d6 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:03.322338 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-17ae2ff5-a531-497b-ae66-bf9951a935d6 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:03.352896 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-17ae2ff5-a531-497b-ae66-bf9951a935d6 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045717 Oct 28 09:51:03.353479 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 301/593] 10.222.0.52 () {60 vars in 1343 bytes} [Fri Oct 28 09:51:03 2022] GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:51:03.394883 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-910af7b6-8d8d-4890-bcb8-a931f3dba3aa tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] 10.222.0.52 "GET /compute/v2.1/servers/e6ddb7f9-7854-4aa1-a174-2048b9a40431/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097523 Oct 28 09:51:03.401536 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 293/594] 10.222.0.52 () {58 vars in 1275 bytes} [Fri Oct 28 09:51:03 2022] GET /compute/v2.1/servers/e6ddb7f9-7854-4aa1-a174-2048b9a40431/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:51:03.428321 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-d4ec6ea8-ba61-4fec-9d48-0b97bb8d8da4 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:03.428904 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-d4ec6ea8-ba61-4fec-9d48-0b97bb8d8da4 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 6869ffb6-ce4f-4a91-b8d9-7765ea56e95a] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:51:03.434992 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-d4ec6ea8-ba61-4fec-9d48-0b97bb8d8da4 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:03.435474 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-d4ec6ea8-ba61-4fec-9d48-0b97bb8d8da4 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:03.435945 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-d4ec6ea8-ba61-4fec-9d48-0b97bb8d8da4 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:03.436657 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-d4ec6ea8-ba61-4fec-9d48-0b97bb8d8da4 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:03.437106 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-d4ec6ea8-ba61-4fec-9d48-0b97bb8d8da4 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:03.437545 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-d4ec6ea8-ba61-4fec-9d48-0b97bb8d8da4 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:03.463036 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-d4ec6ea8-ba61-4fec-9d48-0b97bb8d8da4 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 6869ffb6-ce4f-4a91-b8d9-7765ea56e95a] Going to try to terminate instance {{(pid=127032) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 09:51:03.477519 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG dbcounter [-] [127032] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:03.544233 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-d4ec6ea8-ba61-4fec-9d48-0b97bb8d8da4 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "DELETE /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a" status: 204 len: 0 microversion: 2.20 time: 0.120008 Oct 28 09:51:03.545019 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 302/595] 10.222.0.52 () {60 vars in 1280 bytes} [Fri Oct 28 09:51:03 2022] DELETE /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 09:51:03.554224 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-f77a242a-af55-45f9-85fb-ff11a8e20bc1 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:03.554849 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-f77a242a-af55-45f9-85fb-ff11a8e20bc1 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 6869ffb6-ce4f-4a91-b8d9-7765ea56e95a] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:51:03.561140 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-f77a242a-af55-45f9-85fb-ff11a8e20bc1 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:03.561669 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-f77a242a-af55-45f9-85fb-ff11a8e20bc1 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:03.562105 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-f77a242a-af55-45f9-85fb-ff11a8e20bc1 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:03.562807 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-f77a242a-af55-45f9-85fb-ff11a8e20bc1 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:03.563265 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-f77a242a-af55-45f9-85fb-ff11a8e20bc1 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:03.563691 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-f77a242a-af55-45f9-85fb-ff11a8e20bc1 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:03.814921 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-f77a242a-af55-45f9-85fb-ff11a8e20bc1 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:03.827281 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-f77a242a-af55-45f9-85fb-ff11a8e20bc1 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:03.828965 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-f77a242a-af55-45f9-85fb-ff11a8e20bc1 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:03.830240 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-f77a242a-af55-45f9-85fb-ff11a8e20bc1 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a" status: 200 len: 1720 microversion: 2.20 time: 0.280609 Oct 28 09:51:03.831477 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 294/596] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:51:03 2022] GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a => generated 1720 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:51:04.553854 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [req-1efc6171-e2eb-4232-b7e2-adf41481b56d req-d3b1ddce-0dce-4856-a7d3-85fcc854ce60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6ddb7f9-7854-4aa1-a174-2048b9a40431", "tag": "02ec0bd8-060a-466c-b33b-8ecb3e609c46"}]} {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:51:04.564131 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-1efc6171-e2eb-4232-b7e2-adf41481b56d req-d3b1ddce-0dce-4856-a7d3-85fcc854ce60 service nova] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:04.564616 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-1efc6171-e2eb-4232-b7e2-adf41481b56d req-d3b1ddce-0dce-4856-a7d3-85fcc854ce60 service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:04.565049 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-1efc6171-e2eb-4232-b7e2-adf41481b56d req-d3b1ddce-0dce-4856-a7d3-85fcc854ce60 service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:04.576507 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.compute.server_external_events [req-1efc6171-e2eb-4232-b7e2-adf41481b56d req-d3b1ddce-0dce-4856-a7d3-85fcc854ce60 service nova] Creating event network-changed:02ec0bd8-060a-466c-b33b-8ecb3e609c46 for instance e6ddb7f9-7854-4aa1-a174-2048b9a40431 on hv-cinder-zed-3 Oct 28 09:51:04.582304 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [req-1efc6171-e2eb-4232-b7e2-adf41481b56d req-d3b1ddce-0dce-4856-a7d3-85fcc854ce60 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032800 Oct 28 09:51:04.583340 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 303/597] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Oct 28 09:51:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:51:04.857225 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-23bb9fe8-6b4f-4126-8fdd-df1a36357772 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:04.857861 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-23bb9fe8-6b4f-4126-8fdd-df1a36357772 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 6869ffb6-ce4f-4a91-b8d9-7765ea56e95a] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:51:04.864820 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-23bb9fe8-6b4f-4126-8fdd-df1a36357772 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:04.865412 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-23bb9fe8-6b4f-4126-8fdd-df1a36357772 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:04.865857 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-23bb9fe8-6b4f-4126-8fdd-df1a36357772 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:04.866554 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-23bb9fe8-6b4f-4126-8fdd-df1a36357772 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:04.867031 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-23bb9fe8-6b4f-4126-8fdd-df1a36357772 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:04.867456 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-23bb9fe8-6b4f-4126-8fdd-df1a36357772 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:05.005761 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-23bb9fe8-6b4f-4126-8fdd-df1a36357772 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:05.014488 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-23bb9fe8-6b4f-4126-8fdd-df1a36357772 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:05.016022 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-23bb9fe8-6b4f-4126-8fdd-df1a36357772 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:05.017242 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-23bb9fe8-6b4f-4126-8fdd-df1a36357772 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a" status: 200 len: 1720 microversion: 2.20 time: 0.163998 Oct 28 09:51:05.018182 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 295/598] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:51:04 2022] GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a => generated 1720 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:51:06.044385 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-c8c09cc4-3162-4819-a6f5-8ff217d94253 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:06.045189 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-c8c09cc4-3162-4819-a6f5-8ff217d94253 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 6869ffb6-ce4f-4a91-b8d9-7765ea56e95a] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:51:06.052041 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-c8c09cc4-3162-4819-a6f5-8ff217d94253 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:06.052576 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-c8c09cc4-3162-4819-a6f5-8ff217d94253 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:06.052966 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-c8c09cc4-3162-4819-a6f5-8ff217d94253 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:06.053673 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-c8c09cc4-3162-4819-a6f5-8ff217d94253 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:06.054122 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-c8c09cc4-3162-4819-a6f5-8ff217d94253 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:06.054543 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-c8c09cc4-3162-4819-a6f5-8ff217d94253 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:06.198231 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-c8c09cc4-3162-4819-a6f5-8ff217d94253 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:06.208251 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-c8c09cc4-3162-4819-a6f5-8ff217d94253 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:06.209883 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-c8c09cc4-3162-4819-a6f5-8ff217d94253 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:06.211101 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-c8c09cc4-3162-4819-a6f5-8ff217d94253 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a" status: 200 len: 1720 microversion: 2.20 time: 0.171309 Oct 28 09:51:06.211786 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 304/599] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:51:06 2022] GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a => generated 1720 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:51:06.597283 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [req-89416444-c4a3-4b39-afd6-5c76fe14e6ca req-6e4e7de6-c137-440b-bad4-c5ebf0309687 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6ddb7f9-7854-4aa1-a174-2048b9a40431", "tag": "02ec0bd8-060a-466c-b33b-8ecb3e609c46"}]} {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:51:06.607885 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-89416444-c4a3-4b39-afd6-5c76fe14e6ca req-6e4e7de6-c137-440b-bad4-c5ebf0309687 service nova] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:06.608407 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-89416444-c4a3-4b39-afd6-5c76fe14e6ca req-6e4e7de6-c137-440b-bad4-c5ebf0309687 service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:06.608828 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-89416444-c4a3-4b39-afd6-5c76fe14e6ca req-6e4e7de6-c137-440b-bad4-c5ebf0309687 service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:06.620521 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.compute.server_external_events [req-89416444-c4a3-4b39-afd6-5c76fe14e6ca req-6e4e7de6-c137-440b-bad4-c5ebf0309687 service nova] Creating event network-changed:02ec0bd8-060a-466c-b33b-8ecb3e609c46 for instance e6ddb7f9-7854-4aa1-a174-2048b9a40431 on hv-cinder-zed-3 Oct 28 09:51:06.625690 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [req-89416444-c4a3-4b39-afd6-5c76fe14e6ca req-6e4e7de6-c137-440b-bad4-c5ebf0309687 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032142 Oct 28 09:51:06.626688 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 296/600] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Oct 28 09:51:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:51:06.968321 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [req-d3a3e50f-576f-4cc1-968a-29d0ecc47432 req-ef2ccbc4-9e10-4a66-9649-3bbc91d661c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6869ffb6-ce4f-4a91-b8d9-7765ea56e95a", "name": "network-vif-deleted", "tag": "f350d1f8-ff54-4a77-b413-0023d0d49856"}]} {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:51:06.983087 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-d3a3e50f-576f-4cc1-968a-29d0ecc47432 req-ef2ccbc4-9e10-4a66-9649-3bbc91d661c9 service nova] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:06.983993 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-d3a3e50f-576f-4cc1-968a-29d0ecc47432 req-ef2ccbc4-9e10-4a66-9649-3bbc91d661c9 service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:06.984653 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-d3a3e50f-576f-4cc1-968a-29d0ecc47432 req-ef2ccbc4-9e10-4a66-9649-3bbc91d661c9 service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:06.999131 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.compute.server_external_events [req-d3a3e50f-576f-4cc1-968a-29d0ecc47432 req-ef2ccbc4-9e10-4a66-9649-3bbc91d661c9 service nova] Creating event network-vif-deleted:f350d1f8-ff54-4a77-b413-0023d0d49856 for instance 6869ffb6-ce4f-4a91-b8d9-7765ea56e95a on hv-cinder-zed-3 Oct 28 09:51:07.005041 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [req-d3a3e50f-576f-4cc1-968a-29d0ecc47432 req-ef2ccbc4-9e10-4a66-9649-3bbc91d661c9 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114927 Oct 28 09:51:07.005900 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 305/601] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Oct 28 09:51:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:51:07.242505 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-9376205f-0c88-431d-b7c2-21039d13bcfe tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:07.243604 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-9376205f-0c88-431d-b7c2-21039d13bcfe tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 6869ffb6-ce4f-4a91-b8d9-7765ea56e95a] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:51:07.250130 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-9376205f-0c88-431d-b7c2-21039d13bcfe tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:07.251078 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-9376205f-0c88-431d-b7c2-21039d13bcfe tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:07.251812 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-9376205f-0c88-431d-b7c2-21039d13bcfe tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:07.252736 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-9376205f-0c88-431d-b7c2-21039d13bcfe tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:07.253356 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-9376205f-0c88-431d-b7c2-21039d13bcfe tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:07.253996 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-9376205f-0c88-431d-b7c2-21039d13bcfe tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:07.307801 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-9376205f-0c88-431d-b7c2-21039d13bcfe tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:07.308741 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-9376205f-0c88-431d-b7c2-21039d13bcfe tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:07.309273 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-9376205f-0c88-431d-b7c2-21039d13bcfe tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:07.309792 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.objects.instance [None req-9376205f-0c88-431d-b7c2-21039d13bcfe tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lazy-loading 'fault' on Instance uuid 6869ffb6-ce4f-4a91-b8d9-7765ea56e95a {{(pid=127033) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:51:07.355443 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-9376205f-0c88-431d-b7c2-21039d13bcfe tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:07.365453 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-9376205f-0c88-431d-b7c2-21039d13bcfe tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:07.366986 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-9376205f-0c88-431d-b7c2-21039d13bcfe tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:07.368110 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-9376205f-0c88-431d-b7c2-21039d13bcfe tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a" status: 200 len: 1370 microversion: 2.20 time: 0.132479 Oct 28 09:51:07.368738 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 297/602] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:51:07 2022] GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a => generated 1370 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:51:08.393995 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-8991f025-8764-4ffb-9f98-a46c7f12f8e2 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:08.394684 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-8991f025-8764-4ffb-9f98-a46c7f12f8e2 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 6869ffb6-ce4f-4a91-b8d9-7765ea56e95a] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:51:08.400856 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-8991f025-8764-4ffb-9f98-a46c7f12f8e2 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:08.401275 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-8991f025-8764-4ffb-9f98-a46c7f12f8e2 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:08.401706 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-8991f025-8764-4ffb-9f98-a46c7f12f8e2 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:08.402421 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-8991f025-8764-4ffb-9f98-a46c7f12f8e2 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:08.402879 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-8991f025-8764-4ffb-9f98-a46c7f12f8e2 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:08.403296 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-8991f025-8764-4ffb-9f98-a46c7f12f8e2 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:08.417201 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.wsgi [None req-8991f025-8764-4ffb-9f98-a46c7f12f8e2 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] HTTP exception thrown: Instance 6869ffb6-ce4f-4a91-b8d9-7765ea56e95a could not be found. Oct 28 09:51:08.418890 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-8991f025-8764-4ffb-9f98-a46c7f12f8e2 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Request method failure captured: Oct 28 09:51:08.418890 dv-cinder-zed-3-smb devstack@n-api.service[127032]: request: GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a HTTP/1.1 Oct 28 09:51:08.418890 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Accept: application/json Oct 28 09:51:08.418890 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Accept-Encoding: identity Oct 28 09:51:08.418890 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Connection: close Oct 28 09:51:08.418890 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Content-Length: 0 Oct 28 09:51:08.418890 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Content-Type: application/json Oct 28 09:51:08.418890 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Host: 10.222.0.52 Oct 28 09:51:08.418890 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Openstack-System-Scope: None Oct 28 09:51:08.418890 dv-cinder-zed-3-smb devstack@n-api.service[127032]: User-Agent: python-urllib3/1.26.12 Oct 28 09:51:08.418890 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Auth-Token: gAAAAABjW6TL-nfZoagrIIL_YkE36KuSDhOXjvGtC86ZbtDlieloNediNRa004asnIbmA7I1lf0tqGniDyzY5Jn6NbXRpQF0NeqHU8m8plx6SCWuxsy2RWYlws615e7915D0F4ZQ8NM-WziiWXtDE7IRn9CZQrYKNwQBHwYHsx6or-8Vv8tPJcE Oct 28 09:51:08.418890 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Domain-Id: None Oct 28 09:51:08.418890 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Domain-Name: None Oct 28 09:51:08.418890 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Identity-Status: Confirmed Oct 28 09:51:08.418890 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Is-Admin-Project: True Oct 28 09:51:08.418890 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Openstack-Nova-Api-Version: 2.20 Oct 28 09:51:08.418890 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Project-Domain-Id: default Oct 28 09:51:08.418890 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Project-Domain-Name: Default Oct 28 09:51:08.418890 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Project-Id: 500be47836b44a769f676e3e4bc00721 Oct 28 09:51:08.418890 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-146892991 Oct 28 09:51:08.418890 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Role: reader,member Oct 28 09:51:08.418890 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Roles: reader,member Oct 28 09:51:08.420659 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_500be47836b44a769f676e3e4bc00721"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/500be47836b44a769f676e3e4bc00721"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/500be47836b44a769f676e3e4bc00721"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/500be47836b44a769f676e3e4bc00721"}]}] Oct 28 09:51:08.420659 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Tenant: tempest-AttachVolumeShelveTestJSON-146892991 Oct 28 09:51:08.420659 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Tenant-Id: 500be47836b44a769f676e3e4bc00721 Oct 28 09:51:08.420659 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-146892991 Oct 28 09:51:08.420659 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-User: tempest-AttachVolumeShelveTestJSON-146892991-project Oct 28 09:51:08.420659 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-User-Domain-Id: default Oct 28 09:51:08.420659 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-User-Domain-Name: Default Oct 28 09:51:08.420659 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-User-Id: cdb5ce192c764fe4946542f5960ccd39 Oct 28 09:51:08.420659 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-User-Name: tempest-AttachVolumeShelveTestJSON-146892991-project Oct 28 09:51:08.420659 dv-cinder-zed-3-smb devstack@n-api.service[127032]: method: > Oct 28 09:51:08.420659 dv-cinder-zed-3-smb devstack@n-api.service[127032]: exception: Instance 6869ffb6-ce4f-4a91-b8d9-7765ea56e95a could not be found. Oct 28 09:51:08.420659 dv-cinder-zed-3-smb devstack@n-api.service[127032]: action_args: {'id': '6869ffb6-ce4f-4a91-b8d9-7765ea56e95a'} Oct 28 09:51:08.421619 dv-cinder-zed-3-smb devstack@n-api.service[127032]: {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:51:08.421619 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:51:08.421619 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 09:51:08.421619 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 09:51:08.421619 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 09:51:08.421619 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 09:51:08.421619 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 09:51:08.421619 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 09:51:08.421619 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 09:51:08.421619 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 09:51:08.421619 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6869ffb6-ce4f-4a91-b8d9-7765ea56e95a could not be found. Oct 28 09:51:08.421619 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Oct 28 09:51:08.421619 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:51:08.421619 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Oct 28 09:51:08.421619 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:51:08.421619 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:51:08.421619 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:51:08.421619 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:51:08.421619 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:51:08.421619 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:51:08.423106 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:51:08.423106 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 09:51:08.423106 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 09:51:08.423106 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 09:51:08.423106 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 09:51:08.423106 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 09:51:08.423106 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 09:51:08.423106 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6869ffb6-ce4f-4a91-b8d9-7765ea56e95a could not be found. Oct 28 09:51:08.423106 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Oct 28 09:51:08.423106 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:51:08.423106 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Oct 28 09:51:08.423106 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:51:08.423106 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:51:08.423106 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:51:08.423106 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:51:08.423106 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:51:08.423106 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6869ffb6-ce4f-4a91-b8d9-7765ea56e95a could not be found. Oct 28 09:51:08.423106 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Oct 28 09:51:08.425598 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-8991f025-8764-4ffb-9f98-a46c7f12f8e2 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Returning 404 to user: Instance 6869ffb6-ce4f-4a91-b8d9-7765ea56e95a could not be found. {{(pid=127032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:51:08.426605 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-8991f025-8764-4ffb-9f98-a46c7f12f8e2 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a" status: 404 len: 111 microversion: 2.20 time: 0.037417 Oct 28 09:51:08.427324 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 306/603] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:51:08 2022] GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 09:51:08.435821 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-0093a5a1-a1a7-4fa9-9028-ceb29868b556 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '.version_select at 0x7ff010111af0>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:08.461648 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-0093a5a1-a1a7-4fa9-9028-ceb29868b556 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-280231662" status: 204 len: 0 microversion: 2.20 time: 0.029664 Oct 28 09:51:08.462254 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 298/604] 10.222.0.52 () {60 vars in 1259 bytes} [Fri Oct 28 09:51:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-280231662 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 09:51:09.120473 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-0b014a4b-c994-424b-a710-69425fe6f7f2 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Action: 'create', calling method: .version_select at 0x7ff010346ee0>, body: {"keypair": {"name": "tempest-keypair-36306893", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL6SQpl51DHM0fIdpMxvN+rMd/CmHJMRhAa/Szj6eFmxAmInsi7TTUmZCm6HhX0aHOmEuefefnZADOqORAg0dm+Gp6DndWf0VJjnWNYzm3Z5dYMcvnfojVci282QdXUHyw=="}} {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:51:09.140241 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.quota [None req-0b014a4b-c994-424b-a710-69425fe6f7f2 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Getting quotas for project 500be47836b44a769f676e3e4bc00721. Resources: {'key_pairs'} {{(pid=127032) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 09:51:09.144724 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.quota [None req-0b014a4b-c994-424b-a710-69425fe6f7f2 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Getting quotas for user cdb5ce192c764fe4946542f5960ccd39 and project 500be47836b44a769f676e3e4bc00721. Resources: {'key_pairs'} {{(pid=127032) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 09:51:09.180774 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-0b014a4b-c994-424b-a710-69425fe6f7f2 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.20 time: 0.064303 Oct 28 09:51:09.181374 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 307/605] 10.222.0.52 () {62 vars in 1200 bytes} [Fri Oct 28 09:51:09 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 66 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 28 09:51:10.433168 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-ec63231f-43e4-4cf0-9f06-7b2c7693600a tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-381275950", "imageRef": "6e314146-a2ed-4f8b-afdd-4f7ed1184d20", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2ac62534-4a8d-47b6-a325-e372ef145ba3"}], "security_groups": [{"name": "tempest-securitygroup--1449217379"}], "key_name": "tempest-keypair-36306893", "user_data": "}} {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:51:10.539908 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.network.neutron [None req-ec63231f-43e4-4cf0-9f06-7b2c7693600a tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] validate_networks() for [('2ac62534-4a8d-47b6-a325-e372ef145ba3', None, None, None, None, None)] {{(pid=127033) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 09:51:10.961955 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.virt.hardware [None req-ec63231f-43e4-4cf0-9f06-7b2c7693600a tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Flavor limits 0:0:0 {{(pid=127033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 09:51:10.962380 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.virt.hardware [None req-ec63231f-43e4-4cf0-9f06-7b2c7693600a tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Image limits 0:0:0 {{(pid=127033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 09:51:10.962856 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.virt.hardware [None req-ec63231f-43e4-4cf0-9f06-7b2c7693600a tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Flavor pref 0:0:0 {{(pid=127033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 09:51:10.963267 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.virt.hardware [None req-ec63231f-43e4-4cf0-9f06-7b2c7693600a tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Image pref 0:0:0 {{(pid=127033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 09:51:10.963680 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.virt.hardware [None req-ec63231f-43e4-4cf0-9f06-7b2c7693600a tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 09:51:10.973539 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-ec63231f-43e4-4cf0-9f06-7b2c7693600a tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:10.974018 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-ec63231f-43e4-4cf0-9f06-7b2c7693600a tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:10.974454 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-ec63231f-43e4-4cf0-9f06-7b2c7693600a tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:10.975172 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-ec63231f-43e4-4cf0-9f06-7b2c7693600a tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:10.975625 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-ec63231f-43e4-4cf0-9f06-7b2c7693600a tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:10.976068 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-ec63231f-43e4-4cf0-9f06-7b2c7693600a tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:10.994364 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.quota [None req-ec63231f-43e4-4cf0-9f06-7b2c7693600a tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Getting quotas for project 500be47836b44a769f676e3e4bc00721. Resources: {'cores', 'ram', 'instances'} {{(pid=127033) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 09:51:10.998410 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.quota [None req-ec63231f-43e4-4cf0-9f06-7b2c7693600a tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Getting quotas for user cdb5ce192c764fe4946542f5960ccd39 and project 500be47836b44a769f676e3e4bc00721. Resources: {'cores', 'ram', 'instances'} {{(pid=127033) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 09:51:11.009458 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-ec63231f-43e4-4cf0-9f06-7b2c7693600a tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Going to run 1 instances... {{(pid=127033) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 09:51:11.011779 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-ec63231f-43e4-4cf0-9f06-7b2c7693600a tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 125194a5-e664-4ea8-ad7e-b0ae1b54e827] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e314146-a2ed-4f8b-afdd-4f7ed1184d20',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127033) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 09:51:11.061090 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-ec63231f-43e4-4cf0-9f06-7b2c7693600a tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.632665 Oct 28 09:51:11.061751 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 299/606] 10.222.0.52 () {62 vars in 1188 bytes} [Fri Oct 28 09:51:10 2022] POST /compute/v2.1/servers => generated 402 bytes in 634 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 28 09:51:11.077865 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-5bd28bf0-0e66-4efb-8371-199e4387a418 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:11.078501 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-5bd28bf0-0e66-4efb-8371-199e4387a418 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 125194a5-e664-4ea8-ad7e-b0ae1b54e827] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:51:11.135579 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-5bd28bf0-0e66-4efb-8371-199e4387a418 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:11.144329 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-5bd28bf0-0e66-4efb-8371-199e4387a418 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:11.145787 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-5bd28bf0-0e66-4efb-8371-199e4387a418 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:11.146935 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-5bd28bf0-0e66-4efb-8371-199e4387a418 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827" status: 200 len: 1279 microversion: 2.20 time: 0.074151 Oct 28 09:51:11.148635 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 308/607] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:51:11 2022] GET /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827 => generated 1279 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:51:12.172177 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-0b713e49-6fa5-49f3-b737-e99ec59451e7 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:12.172784 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-0b713e49-6fa5-49f3-b737-e99ec59451e7 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 125194a5-e664-4ea8-ad7e-b0ae1b54e827] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:51:12.178710 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-0b713e49-6fa5-49f3-b737-e99ec59451e7 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:12.179191 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-0b713e49-6fa5-49f3-b737-e99ec59451e7 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:12.179624 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-0b713e49-6fa5-49f3-b737-e99ec59451e7 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:12.180329 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-0b713e49-6fa5-49f3-b737-e99ec59451e7 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:12.180783 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-0b713e49-6fa5-49f3-b737-e99ec59451e7 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:12.181202 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-0b713e49-6fa5-49f3-b737-e99ec59451e7 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:12.242679 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-0b713e49-6fa5-49f3-b737-e99ec59451e7 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:12.250887 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-0b713e49-6fa5-49f3-b737-e99ec59451e7 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:12.252350 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-0b713e49-6fa5-49f3-b737-e99ec59451e7 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:12.253444 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-0b713e49-6fa5-49f3-b737-e99ec59451e7 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827" status: 200 len: 1331 microversion: 2.20 time: 0.085702 Oct 28 09:51:12.253989 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 300/608] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:51:12 2022] GET /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827 => generated 1331 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:51:13.279024 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-71e87855-44a1-417e-9dd0-00fb1055d055 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:13.280300 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-71e87855-44a1-417e-9dd0-00fb1055d055 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 125194a5-e664-4ea8-ad7e-b0ae1b54e827] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:51:13.282793 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG dbcounter [-] [127032] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=127032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:13.289272 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-71e87855-44a1-417e-9dd0-00fb1055d055 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:13.289917 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-71e87855-44a1-417e-9dd0-00fb1055d055 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:13.290263 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-71e87855-44a1-417e-9dd0-00fb1055d055 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:13.290957 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-71e87855-44a1-417e-9dd0-00fb1055d055 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:13.291414 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-71e87855-44a1-417e-9dd0-00fb1055d055 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:13.292100 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-71e87855-44a1-417e-9dd0-00fb1055d055 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:13.437436 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-71e87855-44a1-417e-9dd0-00fb1055d055 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:13.446843 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-71e87855-44a1-417e-9dd0-00fb1055d055 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:13.448344 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-71e87855-44a1-417e-9dd0-00fb1055d055 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:13.449452 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-71e87855-44a1-417e-9dd0-00fb1055d055 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827" status: 200 len: 1405 microversion: 2.20 time: 0.174633 Oct 28 09:51:13.450013 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 309/609] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:51:13 2022] GET /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827 => generated 1405 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:51:13.869960 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [req-9e6cbffe-b21d-48c5-b42a-49a1fea4436c req-4216f3dc-489f-4ae5-bd4f-82f5c686400e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "125194a5-e664-4ea8-ad7e-b0ae1b54e827", "tag": "ff843068-026c-460b-ae99-a8c3ca1fb539"}]} {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:51:13.875933 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG dbcounter [-] [127033] Writing DB stats nova_api:SELECT=60,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:13.883213 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-9e6cbffe-b21d-48c5-b42a-49a1fea4436c req-4216f3dc-489f-4ae5-bd4f-82f5c686400e service nova] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:13.883690 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-9e6cbffe-b21d-48c5-b42a-49a1fea4436c req-4216f3dc-489f-4ae5-bd4f-82f5c686400e service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:13.884135 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-9e6cbffe-b21d-48c5-b42a-49a1fea4436c req-4216f3dc-489f-4ae5-bd4f-82f5c686400e service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:13.896284 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.compute.server_external_events [req-9e6cbffe-b21d-48c5-b42a-49a1fea4436c req-4216f3dc-489f-4ae5-bd4f-82f5c686400e service nova] Creating event network-changed:ff843068-026c-460b-ae99-a8c3ca1fb539 for instance 125194a5-e664-4ea8-ad7e-b0ae1b54e827 on hv-cinder-zed-3 Oct 28 09:51:13.901201 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [req-9e6cbffe-b21d-48c5-b42a-49a1fea4436c req-4216f3dc-489f-4ae5-bd4f-82f5c686400e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036594 Oct 28 09:51:13.902012 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 301/610] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Oct 28 09:51:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 09:51:14.477243 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-1a252ac5-1363-4ce9-a781-95fe4a812bfd tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:14.477852 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-1a252ac5-1363-4ce9-a781-95fe4a812bfd tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 125194a5-e664-4ea8-ad7e-b0ae1b54e827] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:51:14.484287 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-1a252ac5-1363-4ce9-a781-95fe4a812bfd tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:14.484773 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-1a252ac5-1363-4ce9-a781-95fe4a812bfd tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:14.485219 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-1a252ac5-1363-4ce9-a781-95fe4a812bfd tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:14.485897 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-1a252ac5-1363-4ce9-a781-95fe4a812bfd tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:14.486617 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-1a252ac5-1363-4ce9-a781-95fe4a812bfd tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:14.487038 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-1a252ac5-1363-4ce9-a781-95fe4a812bfd tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:14.616789 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-1a252ac5-1363-4ce9-a781-95fe4a812bfd tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:14.624726 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-1a252ac5-1363-4ce9-a781-95fe4a812bfd tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:14.626173 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-1a252ac5-1363-4ce9-a781-95fe4a812bfd tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:14.627806 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-1a252ac5-1363-4ce9-a781-95fe4a812bfd tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827" status: 200 len: 1405 microversion: 2.20 time: 0.154011 Oct 28 09:51:14.628367 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 310/611] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:51:14 2022] GET /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827 => generated 1405 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:51:15.654493 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-177a29c7-eab8-4157-8fce-bb42cfb0175d tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:15.655183 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-177a29c7-eab8-4157-8fce-bb42cfb0175d tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 125194a5-e664-4ea8-ad7e-b0ae1b54e827] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:51:15.661917 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-177a29c7-eab8-4157-8fce-bb42cfb0175d tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:15.662393 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-177a29c7-eab8-4157-8fce-bb42cfb0175d tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:15.662831 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-177a29c7-eab8-4157-8fce-bb42cfb0175d tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:15.663505 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-177a29c7-eab8-4157-8fce-bb42cfb0175d tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:15.663997 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-177a29c7-eab8-4157-8fce-bb42cfb0175d tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:15.664419 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-177a29c7-eab8-4157-8fce-bb42cfb0175d tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:15.792938 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-177a29c7-eab8-4157-8fce-bb42cfb0175d tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:15.801470 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-177a29c7-eab8-4157-8fce-bb42cfb0175d tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:15.802933 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-177a29c7-eab8-4157-8fce-bb42cfb0175d tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:15.804057 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-177a29c7-eab8-4157-8fce-bb42cfb0175d tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827" status: 200 len: 1405 microversion: 2.20 time: 0.154400 Oct 28 09:51:15.804621 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 302/612] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:51:15 2022] GET /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827 => generated 1405 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:51:16.829429 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-b4611149-95f5-41a3-a2d3-ef7b3b22c0b2 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:16.830040 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-b4611149-95f5-41a3-a2d3-ef7b3b22c0b2 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 125194a5-e664-4ea8-ad7e-b0ae1b54e827] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:51:16.836755 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-b4611149-95f5-41a3-a2d3-ef7b3b22c0b2 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:16.837178 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-b4611149-95f5-41a3-a2d3-ef7b3b22c0b2 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:16.837612 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-b4611149-95f5-41a3-a2d3-ef7b3b22c0b2 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:16.838347 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-b4611149-95f5-41a3-a2d3-ef7b3b22c0b2 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:16.838800 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-b4611149-95f5-41a3-a2d3-ef7b3b22c0b2 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:16.839220 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-b4611149-95f5-41a3-a2d3-ef7b3b22c0b2 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:16.975192 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-b4611149-95f5-41a3-a2d3-ef7b3b22c0b2 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:16.983337 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-b4611149-95f5-41a3-a2d3-ef7b3b22c0b2 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:16.984817 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-b4611149-95f5-41a3-a2d3-ef7b3b22c0b2 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:16.985929 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-b4611149-95f5-41a3-a2d3-ef7b3b22c0b2 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827" status: 200 len: 1405 microversion: 2.20 time: 0.160406 Oct 28 09:51:16.987372 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 311/613] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:51:16 2022] GET /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827 => generated 1405 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:51:18.012144 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-9fbdcb93-7115-4c9d-affb-b5ffc3f31209 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:18.012788 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-9fbdcb93-7115-4c9d-affb-b5ffc3f31209 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 125194a5-e664-4ea8-ad7e-b0ae1b54e827] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:51:18.019516 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-9fbdcb93-7115-4c9d-affb-b5ffc3f31209 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:18.020038 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-9fbdcb93-7115-4c9d-affb-b5ffc3f31209 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:18.020478 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-9fbdcb93-7115-4c9d-affb-b5ffc3f31209 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:18.021169 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-9fbdcb93-7115-4c9d-affb-b5ffc3f31209 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:18.021626 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-9fbdcb93-7115-4c9d-affb-b5ffc3f31209 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:18.022052 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-9fbdcb93-7115-4c9d-affb-b5ffc3f31209 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:18.150847 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-9fbdcb93-7115-4c9d-affb-b5ffc3f31209 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:18.159117 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-9fbdcb93-7115-4c9d-affb-b5ffc3f31209 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:18.160599 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-9fbdcb93-7115-4c9d-affb-b5ffc3f31209 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:18.161710 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-9fbdcb93-7115-4c9d-affb-b5ffc3f31209 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827" status: 200 len: 1405 microversion: 2.20 time: 0.153831 Oct 28 09:51:18.162277 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 303/614] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:51:18 2022] GET /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827 => generated 1405 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:51:19.186574 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-1b582286-cb45-4d0b-b43c-29b01f7091ee tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:19.187188 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-1b582286-cb45-4d0b-b43c-29b01f7091ee tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 125194a5-e664-4ea8-ad7e-b0ae1b54e827] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:51:19.194556 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-1b582286-cb45-4d0b-b43c-29b01f7091ee tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:19.195041 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-1b582286-cb45-4d0b-b43c-29b01f7091ee tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:19.195474 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-1b582286-cb45-4d0b-b43c-29b01f7091ee tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:19.196451 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-1b582286-cb45-4d0b-b43c-29b01f7091ee tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:19.197051 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-1b582286-cb45-4d0b-b43c-29b01f7091ee tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:19.197330 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-1b582286-cb45-4d0b-b43c-29b01f7091ee tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:19.330683 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-1b582286-cb45-4d0b-b43c-29b01f7091ee tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:19.339178 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-1b582286-cb45-4d0b-b43c-29b01f7091ee tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:19.340643 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-1b582286-cb45-4d0b-b43c-29b01f7091ee tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:19.341733 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-1b582286-cb45-4d0b-b43c-29b01f7091ee tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827" status: 200 len: 1405 microversion: 2.20 time: 0.159123 Oct 28 09:51:19.342285 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 312/615] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:51:19 2022] GET /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827 => generated 1405 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:51:19.927461 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [req-5efd7117-11e2-4977-8333-b9fb5950c114 req-fb3727bc-d5c4-4af5-92db-05358c1ccb3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "125194a5-e664-4ea8-ad7e-b0ae1b54e827", "name": "network-vif-plugged", "status": "completed", "tag": "ff843068-026c-460b-ae99-a8c3ca1fb539"}]} {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:51:19.938317 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-5efd7117-11e2-4977-8333-b9fb5950c114 req-fb3727bc-d5c4-4af5-92db-05358c1ccb3d service nova] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:19.938901 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-5efd7117-11e2-4977-8333-b9fb5950c114 req-fb3727bc-d5c4-4af5-92db-05358c1ccb3d service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:19.939518 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-5efd7117-11e2-4977-8333-b9fb5950c114 req-fb3727bc-d5c4-4af5-92db-05358c1ccb3d service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:19.950741 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.compute.server_external_events [req-5efd7117-11e2-4977-8333-b9fb5950c114 req-fb3727bc-d5c4-4af5-92db-05358c1ccb3d service nova] Creating event network-vif-plugged:ff843068-026c-460b-ae99-a8c3ca1fb539 for instance 125194a5-e664-4ea8-ad7e-b0ae1b54e827 on hv-cinder-zed-3 Oct 28 09:51:19.956112 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [req-5efd7117-11e2-4977-8333-b9fb5950c114 req-fb3727bc-d5c4-4af5-92db-05358c1ccb3d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096169 Oct 28 09:51:19.956716 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 304/616] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Oct 28 09:51:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:51:20.366233 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-648b16cf-73b8-4a83-93c5-c7982c0339a7 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:20.366814 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-648b16cf-73b8-4a83-93c5-c7982c0339a7 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 125194a5-e664-4ea8-ad7e-b0ae1b54e827] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:51:20.373402 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-648b16cf-73b8-4a83-93c5-c7982c0339a7 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:20.373883 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-648b16cf-73b8-4a83-93c5-c7982c0339a7 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:20.374336 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-648b16cf-73b8-4a83-93c5-c7982c0339a7 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:20.375011 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-648b16cf-73b8-4a83-93c5-c7982c0339a7 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:20.375452 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-648b16cf-73b8-4a83-93c5-c7982c0339a7 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:20.375969 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-648b16cf-73b8-4a83-93c5-c7982c0339a7 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:20.504453 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-648b16cf-73b8-4a83-93c5-c7982c0339a7 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:20.512930 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-648b16cf-73b8-4a83-93c5-c7982c0339a7 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:20.514378 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-648b16cf-73b8-4a83-93c5-c7982c0339a7 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:20.515488 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-648b16cf-73b8-4a83-93c5-c7982c0339a7 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827" status: 200 len: 1405 microversion: 2.20 time: 0.153218 Oct 28 09:51:20.516381 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 313/617] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:51:20 2022] GET /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827 => generated 1405 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:51:21.538399 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG dbcounter [-] [127033] Writing DB stats nova_cell0:SELECT=2 {{(pid=127033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:21.539501 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG dbcounter [-] [127033] Writing DB stats nova_cell0:SELECT=6 {{(pid=127033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:21.544080 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-894f26e1-5d5d-4603-a296-d402d01f70bb tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:21.544779 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-894f26e1-5d5d-4603-a296-d402d01f70bb tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 125194a5-e664-4ea8-ad7e-b0ae1b54e827] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:51:21.552588 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-894f26e1-5d5d-4603-a296-d402d01f70bb tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:21.553082 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-894f26e1-5d5d-4603-a296-d402d01f70bb tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:21.553517 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-894f26e1-5d5d-4603-a296-d402d01f70bb tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:21.554213 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-894f26e1-5d5d-4603-a296-d402d01f70bb tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:21.554676 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-894f26e1-5d5d-4603-a296-d402d01f70bb tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:21.555135 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-894f26e1-5d5d-4603-a296-d402d01f70bb tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:21.684688 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-894f26e1-5d5d-4603-a296-d402d01f70bb tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:21.692886 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-894f26e1-5d5d-4603-a296-d402d01f70bb tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:21.694349 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-894f26e1-5d5d-4603-a296-d402d01f70bb tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:21.695446 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-894f26e1-5d5d-4603-a296-d402d01f70bb tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827" status: 200 len: 1405 microversion: 2.20 time: 0.158544 Oct 28 09:51:21.696030 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 305/618] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:51:21 2022] GET /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827 => generated 1405 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:51:22.720775 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-a25470ba-d44f-4782-822f-87f57df39b4b tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:22.721410 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-a25470ba-d44f-4782-822f-87f57df39b4b tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 125194a5-e664-4ea8-ad7e-b0ae1b54e827] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:51:22.723856 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG dbcounter [-] [127032] Writing DB stats nova_cell0:SELECT=6 {{(pid=127032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:22.730419 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-a25470ba-d44f-4782-822f-87f57df39b4b tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:22.731201 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-a25470ba-d44f-4782-822f-87f57df39b4b tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:22.731641 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-a25470ba-d44f-4782-822f-87f57df39b4b tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:22.732373 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-a25470ba-d44f-4782-822f-87f57df39b4b tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:22.732829 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-a25470ba-d44f-4782-822f-87f57df39b4b tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:22.733256 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-a25470ba-d44f-4782-822f-87f57df39b4b tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:22.866665 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-a25470ba-d44f-4782-822f-87f57df39b4b tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:22.874779 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-a25470ba-d44f-4782-822f-87f57df39b4b tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:22.876311 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-a25470ba-d44f-4782-822f-87f57df39b4b tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:22.877459 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-a25470ba-d44f-4782-822f-87f57df39b4b tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827" status: 200 len: 1596 microversion: 2.20 time: 0.160585 Oct 28 09:51:22.878016 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 314/619] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:51:22 2022] GET /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827 => generated 1596 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:51:22.909134 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-b105b749-5b16-4640-bd5c-62bc3577edec tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:22.909925 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-b105b749-5b16-4640-bd5c-62bc3577edec tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 125194a5-e664-4ea8-ad7e-b0ae1b54e827] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:51:22.916573 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-b105b749-5b16-4640-bd5c-62bc3577edec tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:22.917059 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-b105b749-5b16-4640-bd5c-62bc3577edec tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:22.917548 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-b105b749-5b16-4640-bd5c-62bc3577edec tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:22.918184 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-b105b749-5b16-4640-bd5c-62bc3577edec tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:22.918634 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-b105b749-5b16-4640-bd5c-62bc3577edec tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:22.919055 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-b105b749-5b16-4640-bd5c-62bc3577edec tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:22.995286 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-b105b749-5b16-4640-bd5c-62bc3577edec tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.090007 Oct 28 09:51:22.995928 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 306/620] 10.222.0.52 () {60 vars in 1316 bytes} [Fri Oct 28 09:51:22 2022] GET /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 09:51:23.921308 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [req-12d4174b-6b20-4f48-99c5-00ac7c86e107 req-43f36086-e04e-4f05-94ac-9dbb65adfe06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "125194a5-e664-4ea8-ad7e-b0ae1b54e827", "tag": "ff843068-026c-460b-ae99-a8c3ca1fb539"}]} {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:51:23.931180 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-12d4174b-6b20-4f48-99c5-00ac7c86e107 req-43f36086-e04e-4f05-94ac-9dbb65adfe06 service nova] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:23.931664 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-12d4174b-6b20-4f48-99c5-00ac7c86e107 req-43f36086-e04e-4f05-94ac-9dbb65adfe06 service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:23.932121 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-12d4174b-6b20-4f48-99c5-00ac7c86e107 req-43f36086-e04e-4f05-94ac-9dbb65adfe06 service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:23.942970 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.compute.server_external_events [req-12d4174b-6b20-4f48-99c5-00ac7c86e107 req-43f36086-e04e-4f05-94ac-9dbb65adfe06 service nova] Creating event network-changed:ff843068-026c-460b-ae99-a8c3ca1fb539 for instance 125194a5-e664-4ea8-ad7e-b0ae1b54e827 on hv-cinder-zed-3 Oct 28 09:51:23.948015 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [req-12d4174b-6b20-4f48-99c5-00ac7c86e107 req-43f36086-e04e-4f05-94ac-9dbb65adfe06 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030352 Oct 28 09:51:23.948622 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 315/621] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Oct 28 09:51:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:51:35.276114 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG dbcounter [-] [127033] Writing DB stats nova_api:SELECT=11 {{(pid=127033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:35.276861 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG dbcounter [-] [127033] Writing DB stats nova_cell1:SELECT=68 {{(pid=127033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:35.281052 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-f500d508-4d0d-4640-abc5-04fe360a60dc tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:35.283209 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-f500d508-4d0d-4640-abc5-04fe360a60dc tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] [instance: 91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:51:35.289859 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-f500d508-4d0d-4640-abc5-04fe360a60dc tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:35.290341 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-f500d508-4d0d-4640-abc5-04fe360a60dc tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:35.290772 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-f500d508-4d0d-4640-abc5-04fe360a60dc tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:35.291454 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-f500d508-4d0d-4640-abc5-04fe360a60dc tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:35.291939 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-f500d508-4d0d-4640-abc5-04fe360a60dc tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:35.292363 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-f500d508-4d0d-4640-abc5-04fe360a60dc tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:35.321943 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-f500d508-4d0d-4640-abc5-04fe360a60dc tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] 10.222.0.52 "GET /compute/v2.1/servers/91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047119 Oct 28 09:51:35.322493 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 307/622] 10.222.0.52 () {58 vars in 1302 bytes} [Fri Oct 28 09:51:35 2022] GET /compute/v2.1/servers/91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 09:51:35.384113 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG dbcounter [-] [127032] Writing DB stats nova_api:SELECT=13 {{(pid=127032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:35.384863 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG dbcounter [-] [127032] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:35.388951 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-5931a6a4-63ee-4e73-b92e-a3d888031284 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:35.389535 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-5931a6a4-63ee-4e73-b92e-a3d888031284 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] [instance: 91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:51:35.396708 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-5931a6a4-63ee-4e73-b92e-a3d888031284 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:35.397189 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-5931a6a4-63ee-4e73-b92e-a3d888031284 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:35.397618 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-5931a6a4-63ee-4e73-b92e-a3d888031284 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:35.398310 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-5931a6a4-63ee-4e73-b92e-a3d888031284 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:35.398765 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-5931a6a4-63ee-4e73-b92e-a3d888031284 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:35.399188 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-5931a6a4-63ee-4e73-b92e-a3d888031284 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:35.424833 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-5931a6a4-63ee-4e73-b92e-a3d888031284 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] [instance: 91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1] Going to try to terminate instance {{(pid=127032) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 09:51:35.500871 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-5931a6a4-63ee-4e73-b92e-a3d888031284 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] 10.222.0.52 "DELETE /compute/v2.1/servers/91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1" status: 204 len: 0 microversion: 2.1 time: 0.118126 Oct 28 09:51:35.501462 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 316/623] 10.222.0.52 () {58 vars in 1239 bytes} [Fri Oct 28 09:51:35 2022] DELETE /compute/v2.1/servers/91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 09:51:35.510443 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-c368e9b6-e99f-444e-b5f8-cc21c45da5d3 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:35.511053 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-c368e9b6-e99f-444e-b5f8-cc21c45da5d3 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] [instance: 91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:51:35.516988 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-c368e9b6-e99f-444e-b5f8-cc21c45da5d3 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:35.517470 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-c368e9b6-e99f-444e-b5f8-cc21c45da5d3 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:35.517905 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-c368e9b6-e99f-444e-b5f8-cc21c45da5d3 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:35.518627 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-c368e9b6-e99f-444e-b5f8-cc21c45da5d3 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:35.519088 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-c368e9b6-e99f-444e-b5f8-cc21c45da5d3 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:35.519505 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-c368e9b6-e99f-444e-b5f8-cc21c45da5d3 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:35.646554 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-c368e9b6-e99f-444e-b5f8-cc21c45da5d3 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bee2d5f599642788c32e0d8b8338c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e7d531c0f4a33a869309af965e3e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:35.654612 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-c368e9b6-e99f-444e-b5f8-cc21c45da5d3 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] 10.222.0.52 "GET /compute/v2.1/servers/91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1" status: 200 len: 1672 microversion: 2.1 time: 0.148071 Oct 28 09:51:35.655193 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 308/624] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:51:35 2022] GET /compute/v2.1/servers/91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1 => generated 1672 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:36.678809 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-93cdfcc7-2aa2-407e-ab23-8b2a938abe6f tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:36.679506 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-93cdfcc7-2aa2-407e-ab23-8b2a938abe6f tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] [instance: 91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:51:36.685846 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-93cdfcc7-2aa2-407e-ab23-8b2a938abe6f tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:36.686328 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-93cdfcc7-2aa2-407e-ab23-8b2a938abe6f tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:36.686765 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-93cdfcc7-2aa2-407e-ab23-8b2a938abe6f tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:36.687453 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-93cdfcc7-2aa2-407e-ab23-8b2a938abe6f tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:36.687958 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-93cdfcc7-2aa2-407e-ab23-8b2a938abe6f tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:36.688367 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-93cdfcc7-2aa2-407e-ab23-8b2a938abe6f tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:36.820682 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-93cdfcc7-2aa2-407e-ab23-8b2a938abe6f tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bee2d5f599642788c32e0d8b8338c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e7d531c0f4a33a869309af965e3e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:36.828555 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-93cdfcc7-2aa2-407e-ab23-8b2a938abe6f tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] 10.222.0.52 "GET /compute/v2.1/servers/91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1" status: 200 len: 1672 microversion: 2.1 time: 0.154143 Oct 28 09:51:36.829124 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 317/625] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:51:36 2022] GET /compute/v2.1/servers/91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1 => generated 1672 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:37.795181 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [req-80316863-557c-458a-bb7f-d489f2d2564b req-52fe3ada-97d1-41f8-a8a1-a6d5fed9e1f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1", "name": "network-vif-deleted", "tag": "21924ff0-b505-4c58-b899-422df9458e67"}]} {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:51:37.810070 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-80316863-557c-458a-bb7f-d489f2d2564b req-52fe3ada-97d1-41f8-a8a1-a6d5fed9e1f1 service nova] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:37.810577 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-80316863-557c-458a-bb7f-d489f2d2564b req-52fe3ada-97d1-41f8-a8a1-a6d5fed9e1f1 service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:37.811003 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-80316863-557c-458a-bb7f-d489f2d2564b req-52fe3ada-97d1-41f8-a8a1-a6d5fed9e1f1 service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:37.823926 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.compute.server_external_events [req-80316863-557c-458a-bb7f-d489f2d2564b req-52fe3ada-97d1-41f8-a8a1-a6d5fed9e1f1 service nova] Creating event network-vif-deleted:21924ff0-b505-4c58-b899-422df9458e67 for instance 91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1 on hv-cinder-zed-3 Oct 28 09:51:37.829783 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [req-80316863-557c-458a-bb7f-d489f2d2564b req-52fe3ada-97d1-41f8-a8a1-a6d5fed9e1f1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038384 Oct 28 09:51:37.831905 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 309/626] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Oct 28 09:51:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:51:37.851896 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-b164dcc2-c535-4f95-b6fd-f18af8512545 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:37.852714 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-b164dcc2-c535-4f95-b6fd-f18af8512545 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] [instance: 91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:51:37.859775 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-b164dcc2-c535-4f95-b6fd-f18af8512545 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:37.860614 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-b164dcc2-c535-4f95-b6fd-f18af8512545 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:37.861331 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-b164dcc2-c535-4f95-b6fd-f18af8512545 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:37.863396 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-b164dcc2-c535-4f95-b6fd-f18af8512545 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:37.864867 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-b164dcc2-c535-4f95-b6fd-f18af8512545 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:37.865505 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-b164dcc2-c535-4f95-b6fd-f18af8512545 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:37.955037 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-b164dcc2-c535-4f95-b6fd-f18af8512545 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bee2d5f599642788c32e0d8b8338c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e7d531c0f4a33a869309af965e3e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:37.964727 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-b164dcc2-c535-4f95-b6fd-f18af8512545 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] 10.222.0.52 "GET /compute/v2.1/servers/91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1" status: 200 len: 1322 microversion: 2.1 time: 0.117169 Oct 28 09:51:37.965900 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 318/627] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:51:37 2022] GET /compute/v2.1/servers/91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1 => generated 1322 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:38.989946 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-7bd012e8-b6d7-4ee5-9065-09edbb7107a2 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:38.990643 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-7bd012e8-b6d7-4ee5-9065-09edbb7107a2 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] [instance: 91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:51:38.996912 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-7bd012e8-b6d7-4ee5-9065-09edbb7107a2 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:38.997394 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-7bd012e8-b6d7-4ee5-9065-09edbb7107a2 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:38.997827 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-7bd012e8-b6d7-4ee5-9065-09edbb7107a2 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:38.998519 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-7bd012e8-b6d7-4ee5-9065-09edbb7107a2 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:38.998978 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-7bd012e8-b6d7-4ee5-9065-09edbb7107a2 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:38.999401 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-7bd012e8-b6d7-4ee5-9065-09edbb7107a2 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:39.013193 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.wsgi [None req-7bd012e8-b6d7-4ee5-9065-09edbb7107a2 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] HTTP exception thrown: Instance 91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1 could not be found. Oct 28 09:51:39.014722 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-7bd012e8-b6d7-4ee5-9065-09edbb7107a2 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Request method failure captured: Oct 28 09:51:39.014722 dv-cinder-zed-3-smb devstack@n-api.service[127033]: request: GET /compute/v2.1/servers/91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1 HTTP/1.1 Oct 28 09:51:39.014722 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Accept: application/json Oct 28 09:51:39.014722 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Accept-Encoding: identity Oct 28 09:51:39.014722 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Connection: close Oct 28 09:51:39.014722 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Content-Length: 0 Oct 28 09:51:39.014722 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Content-Type: application/json Oct 28 09:51:39.014722 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Host: 10.222.0.52 Oct 28 09:51:39.014722 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Openstack-System-Scope: None Oct 28 09:51:39.014722 dv-cinder-zed-3-smb devstack@n-api.service[127033]: User-Agent: python-urllib3/1.26.12 Oct 28 09:51:39.014722 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Auth-Token: gAAAAABjW6TD9gyeIuaR3GZnkXNTUkXtEWiBtJhnH1ZHtIP9Q-UzXgQkL9OETwQ-XY-K-y6hcVC-UecjL0EOysrO2ml0mQLinXVtKN01SwTeCDiv6B_di23_WN7mIn7aa1bR2QSZEmjafQl67q_AfzlzMbAAzFQ1afrDtzqVY8EsC_V-oVdfohE Oct 28 09:51:39.014722 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Domain-Id: None Oct 28 09:51:39.014722 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Domain-Name: None Oct 28 09:51:39.014722 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Identity-Status: Confirmed Oct 28 09:51:39.014722 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Is-Admin-Project: True Oct 28 09:51:39.014722 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Project-Domain-Id: default Oct 28 09:51:39.014722 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Project-Domain-Name: Default Oct 28 09:51:39.014722 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Project-Id: ae5e7d531c0f4a33a869309af965e3e5 Oct 28 09:51:39.014722 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Project-Name: tempest-AttachVolumeTestJSON-520170005 Oct 28 09:51:39.014722 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Role: reader,member Oct 28 09:51:39.014722 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Roles: reader,member Oct 28 09:51:39.016304 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ae5e7d531c0f4a33a869309af965e3e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ae5e7d531c0f4a33a869309af965e3e5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ae5e7d531c0f4a33a869309af965e3e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ae5e7d531c0f4a33a869309af965e3e5"}]}] Oct 28 09:51:39.016304 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Tenant: tempest-AttachVolumeTestJSON-520170005 Oct 28 09:51:39.016304 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Tenant-Id: ae5e7d531c0f4a33a869309af965e3e5 Oct 28 09:51:39.016304 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Tenant-Name: tempest-AttachVolumeTestJSON-520170005 Oct 28 09:51:39.016304 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User: tempest-AttachVolumeTestJSON-520170005-project Oct 28 09:51:39.016304 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User-Domain-Id: default Oct 28 09:51:39.016304 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User-Domain-Name: Default Oct 28 09:51:39.016304 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User-Id: 8bee2d5f599642788c32e0d8b8338c19 Oct 28 09:51:39.016304 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User-Name: tempest-AttachVolumeTestJSON-520170005-project Oct 28 09:51:39.016304 dv-cinder-zed-3-smb devstack@n-api.service[127033]: method: > Oct 28 09:51:39.016304 dv-cinder-zed-3-smb devstack@n-api.service[127033]: exception: Instance 91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1 could not be found. Oct 28 09:51:39.016304 dv-cinder-zed-3-smb devstack@n-api.service[127033]: action_args: {'id': '91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1'} Oct 28 09:51:39.017266 dv-cinder-zed-3-smb devstack@n-api.service[127033]: {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:51:39.017266 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:51:39.017266 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 09:51:39.017266 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 09:51:39.017266 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 09:51:39.017266 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 09:51:39.017266 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 09:51:39.017266 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 09:51:39.017266 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 09:51:39.017266 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 09:51:39.017266 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1 could not be found. Oct 28 09:51:39.017266 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:51:39.017266 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:51:39.017266 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:51:39.017266 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:51:39.017266 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:51:39.017266 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:51:39.017266 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:51:39.017266 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:51:39.017266 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:51:39.018753 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:51:39.018753 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 09:51:39.018753 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 09:51:39.018753 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 09:51:39.018753 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 09:51:39.018753 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 09:51:39.018753 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 09:51:39.018753 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1 could not be found. Oct 28 09:51:39.018753 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:51:39.018753 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:51:39.018753 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:51:39.018753 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:51:39.018753 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:51:39.018753 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:51:39.018753 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:51:39.018753 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:51:39.018753 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1 could not be found. Oct 28 09:51:39.018753 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:51:39.020505 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-7bd012e8-b6d7-4ee5-9065-09edbb7107a2 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Returning 404 to user: Instance 91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1 could not be found. {{(pid=127033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:51:39.020505 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-7bd012e8-b6d7-4ee5-9065-09edbb7107a2 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] 10.222.0.52 "GET /compute/v2.1/servers/91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1" status: 404 len: 111 microversion: 2.1 time: 0.031696 Oct 28 09:51:39.020505 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 310/628] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:51:38 2022] GET /compute/v2.1/servers/91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:51:39.025194 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-eb762343-b15e-4c0a-a046-969d96a574b4 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Calling method '.version_select at 0x7ff0101813a0>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:39.044688 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-eb762343-b15e-4c0a-a046-969d96a574b4 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-501666664" status: 202 len: 0 microversion: 2.1 time: 0.023436 Oct 28 09:51:39.045255 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 319/629] 10.222.0.52 () {58 vars in 1218 bytes} [Fri Oct 28 09:51:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-501666664 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:51:39.679247 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-f998939b-3516-49a1-bd9e-2b4b32d3e0ea tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Action: 'create', calling method: .version_select at 0x7ff01014d040>, body: {"keypair": {"name": "tempest-keypair-1913484389", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO1gZ09My8pGouHxbQwsd5ysLBnR/U3C+2298GRlzPi668SuyL1G6MTXut3JMOgWaDBP9417XBHIp13a9Y78IZVZ3rUO03HRSf7OgTYiUXKxtJc0M1rlVvlZ3+4KIJrvbg=="}} {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:51:39.695834 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.quota [None req-f998939b-3516-49a1-bd9e-2b4b32d3e0ea tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Getting quotas for project ae5e7d531c0f4a33a869309af965e3e5. Resources: {'key_pairs'} {{(pid=127033) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 09:51:39.699816 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.quota [None req-f998939b-3516-49a1-bd9e-2b4b32d3e0ea tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Getting quotas for user 8bee2d5f599642788c32e0d8b8338c19 and project ae5e7d531c0f4a33a869309af965e3e5. Resources: {'key_pairs'} {{(pid=127033) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 09:51:39.721627 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-f998939b-3516-49a1-bd9e-2b4b32d3e0ea tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.046802 Oct 28 09:51:39.722412 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 311/630] 10.222.0.52 () {60 vars in 1159 bytes} [Fri Oct 28 09:51:39 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:51:40.951999 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-2b63101a-155f-47f0-b305-6f5d4ed30c0e tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-533293080", "imageRef": "6e314146-a2ed-4f8b-afdd-4f7ed1184d20", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3e35dfd4-7f9d-4a28-8cf6-3cf4d8a0ceaa"}], "security_groups": [{"name": "tempest-securitygroup--978969358"}], "key_name": "tempest-keypair-1913484389", "user_data": "}} {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:51:41.055274 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.network.neutron [None req-2b63101a-155f-47f0-b305-6f5d4ed30c0e tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] validate_networks() for [('3e35dfd4-7f9d-4a28-8cf6-3cf4d8a0ceaa', None, None, None, None, None)] {{(pid=127032) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 09:51:41.652599 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.virt.hardware [None req-2b63101a-155f-47f0-b305-6f5d4ed30c0e tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Flavor limits 0:0:0 {{(pid=127032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 09:51:41.653025 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.virt.hardware [None req-2b63101a-155f-47f0-b305-6f5d4ed30c0e tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Image limits 0:0:0 {{(pid=127032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 09:51:41.653532 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.virt.hardware [None req-2b63101a-155f-47f0-b305-6f5d4ed30c0e tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Flavor pref 0:0:0 {{(pid=127032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 09:51:41.653942 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.virt.hardware [None req-2b63101a-155f-47f0-b305-6f5d4ed30c0e tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Image pref 0:0:0 {{(pid=127032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 09:51:41.654355 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.virt.hardware [None req-2b63101a-155f-47f0-b305-6f5d4ed30c0e tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 09:51:41.663497 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-2b63101a-155f-47f0-b305-6f5d4ed30c0e tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:41.664012 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-2b63101a-155f-47f0-b305-6f5d4ed30c0e tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:41.664484 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-2b63101a-155f-47f0-b305-6f5d4ed30c0e tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:41.665208 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-2b63101a-155f-47f0-b305-6f5d4ed30c0e tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:41.665661 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-2b63101a-155f-47f0-b305-6f5d4ed30c0e tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:41.666083 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-2b63101a-155f-47f0-b305-6f5d4ed30c0e tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:41.683087 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.quota [None req-2b63101a-155f-47f0-b305-6f5d4ed30c0e tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Getting quotas for project ae5e7d531c0f4a33a869309af965e3e5. Resources: {'cores', 'ram', 'instances'} {{(pid=127032) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 09:51:41.687022 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.quota [None req-2b63101a-155f-47f0-b305-6f5d4ed30c0e tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Getting quotas for user 8bee2d5f599642788c32e0d8b8338c19 and project ae5e7d531c0f4a33a869309af965e3e5. Resources: {'cores', 'ram', 'instances'} {{(pid=127032) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 09:51:41.697853 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-2b63101a-155f-47f0-b305-6f5d4ed30c0e tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Going to run 1 instances... {{(pid=127032) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 09:51:41.700161 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-2b63101a-155f-47f0-b305-6f5d4ed30c0e tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] [instance: ae78bc7d-2e36-42d6-bcef-686291983088] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e314146-a2ed-4f8b-afdd-4f7ed1184d20',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127032) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 09:51:41.748837 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-2b63101a-155f-47f0-b305-6f5d4ed30c0e tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.801147 Oct 28 09:51:41.749487 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 320/631] 10.222.0.52 () {60 vars in 1147 bytes} [Fri Oct 28 09:51:40 2022] POST /compute/v2.1/servers => generated 401 bytes in 802 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 09:51:41.761143 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-53ec208a-8901-43f0-ad8a-47cb40fc6cd5 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:41.761757 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-53ec208a-8901-43f0-ad8a-47cb40fc6cd5 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] [instance: ae78bc7d-2e36-42d6-bcef-686291983088] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:51:41.816991 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-53ec208a-8901-43f0-ad8a-47cb40fc6cd5 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bee2d5f599642788c32e0d8b8338c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e7d531c0f4a33a869309af965e3e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:41.824215 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-53ec208a-8901-43f0-ad8a-47cb40fc6cd5 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] 10.222.0.52 "GET /compute/v2.1/servers/ae78bc7d-2e36-42d6-bcef-686291983088" status: 200 len: 1237 microversion: 2.1 time: 0.067402 Oct 28 09:51:41.824791 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 312/632] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:51:41 2022] GET /compute/v2.1/servers/ae78bc7d-2e36-42d6-bcef-686291983088 => generated 1237 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:42.846827 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-faac0338-e38d-4c21-b9ed-c516c8254ad9 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:42.847439 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-faac0338-e38d-4c21-b9ed-c516c8254ad9 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] [instance: ae78bc7d-2e36-42d6-bcef-686291983088] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:51:42.903197 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-faac0338-e38d-4c21-b9ed-c516c8254ad9 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bee2d5f599642788c32e0d8b8338c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e7d531c0f4a33a869309af965e3e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:42.911204 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-faac0338-e38d-4c21-b9ed-c516c8254ad9 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] 10.222.0.52 "GET /compute/v2.1/servers/ae78bc7d-2e36-42d6-bcef-686291983088" status: 200 len: 1237 microversion: 2.1 time: 0.067982 Oct 28 09:51:42.911817 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 321/633] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:51:42 2022] GET /compute/v2.1/servers/ae78bc7d-2e36-42d6-bcef-686291983088 => generated 1237 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:43.934643 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-a5acc5c8-d694-459c-912a-10c4ea778392 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:43.935254 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-a5acc5c8-d694-459c-912a-10c4ea778392 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] [instance: ae78bc7d-2e36-42d6-bcef-686291983088] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:51:43.999177 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-a5acc5c8-d694-459c-912a-10c4ea778392 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bee2d5f599642788c32e0d8b8338c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e7d531c0f4a33a869309af965e3e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:44.006962 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-a5acc5c8-d694-459c-912a-10c4ea778392 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] 10.222.0.52 "GET /compute/v2.1/servers/ae78bc7d-2e36-42d6-bcef-686291983088" status: 200 len: 1237 microversion: 2.1 time: 0.076997 Oct 28 09:51:44.007656 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 313/634] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:51:43 2022] GET /compute/v2.1/servers/ae78bc7d-2e36-42d6-bcef-686291983088 => generated 1237 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:45.032426 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-0823d5ce-74f5-4cb6-9b47-d825e22dba9c tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:45.032979 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-0823d5ce-74f5-4cb6-9b47-d825e22dba9c tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] [instance: ae78bc7d-2e36-42d6-bcef-686291983088] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:51:45.090592 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-0823d5ce-74f5-4cb6-9b47-d825e22dba9c tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bee2d5f599642788c32e0d8b8338c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e7d531c0f4a33a869309af965e3e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:45.097838 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-0823d5ce-74f5-4cb6-9b47-d825e22dba9c tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] 10.222.0.52 "GET /compute/v2.1/servers/ae78bc7d-2e36-42d6-bcef-686291983088" status: 200 len: 1237 microversion: 2.1 time: 0.069336 Oct 28 09:51:45.099030 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 322/635] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:51:45 2022] GET /compute/v2.1/servers/ae78bc7d-2e36-42d6-bcef-686291983088 => generated 1237 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:46.121667 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-9b29bffa-5b3f-41ed-a6ee-a66c21f83ce3 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:46.122270 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-9b29bffa-5b3f-41ed-a6ee-a66c21f83ce3 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] [instance: ae78bc7d-2e36-42d6-bcef-686291983088] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:51:46.130844 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-9b29bffa-5b3f-41ed-a6ee-a66c21f83ce3 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:46.131346 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-9b29bffa-5b3f-41ed-a6ee-a66c21f83ce3 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:46.131841 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-9b29bffa-5b3f-41ed-a6ee-a66c21f83ce3 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:46.132562 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-9b29bffa-5b3f-41ed-a6ee-a66c21f83ce3 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:46.133020 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-9b29bffa-5b3f-41ed-a6ee-a66c21f83ce3 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:46.133457 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-9b29bffa-5b3f-41ed-a6ee-a66c21f83ce3 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:46.197343 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-9b29bffa-5b3f-41ed-a6ee-a66c21f83ce3 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bee2d5f599642788c32e0d8b8338c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e7d531c0f4a33a869309af965e3e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:46.205243 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-9b29bffa-5b3f-41ed-a6ee-a66c21f83ce3 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] 10.222.0.52 "GET /compute/v2.1/servers/ae78bc7d-2e36-42d6-bcef-686291983088" status: 200 len: 1241 microversion: 2.1 time: 0.087431 Oct 28 09:51:46.205842 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 314/636] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:51:46 2022] GET /compute/v2.1/servers/ae78bc7d-2e36-42d6-bcef-686291983088 => generated 1241 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:47.229024 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-14d353d7-eb77-441c-81a6-914ea469ad0c tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:47.229659 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-14d353d7-eb77-441c-81a6-914ea469ad0c tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] [instance: ae78bc7d-2e36-42d6-bcef-686291983088] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:51:47.236830 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-14d353d7-eb77-441c-81a6-914ea469ad0c tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:47.237619 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-14d353d7-eb77-441c-81a6-914ea469ad0c tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:47.238088 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-14d353d7-eb77-441c-81a6-914ea469ad0c tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:47.239321 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-14d353d7-eb77-441c-81a6-914ea469ad0c tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:47.239932 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-14d353d7-eb77-441c-81a6-914ea469ad0c tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:47.240283 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-14d353d7-eb77-441c-81a6-914ea469ad0c tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:47.304945 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-14d353d7-eb77-441c-81a6-914ea469ad0c tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bee2d5f599642788c32e0d8b8338c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e7d531c0f4a33a869309af965e3e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:47.312829 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-14d353d7-eb77-441c-81a6-914ea469ad0c tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] 10.222.0.52 "GET /compute/v2.1/servers/ae78bc7d-2e36-42d6-bcef-686291983088" status: 200 len: 1295 microversion: 2.1 time: 0.087801 Oct 28 09:51:47.313423 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 323/637] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:51:47 2022] GET /compute/v2.1/servers/ae78bc7d-2e36-42d6-bcef-686291983088 => generated 1295 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:48.337143 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-aede53cc-fee1-4dd5-a0c9-2876fba0ab58 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:48.337790 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-aede53cc-fee1-4dd5-a0c9-2876fba0ab58 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] [instance: ae78bc7d-2e36-42d6-bcef-686291983088] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:51:48.344394 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-aede53cc-fee1-4dd5-a0c9-2876fba0ab58 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:48.344871 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-aede53cc-fee1-4dd5-a0c9-2876fba0ab58 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:48.345304 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-aede53cc-fee1-4dd5-a0c9-2876fba0ab58 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:48.345999 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-aede53cc-fee1-4dd5-a0c9-2876fba0ab58 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:48.346452 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-aede53cc-fee1-4dd5-a0c9-2876fba0ab58 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:48.346873 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-aede53cc-fee1-4dd5-a0c9-2876fba0ab58 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:48.486562 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-aede53cc-fee1-4dd5-a0c9-2876fba0ab58 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bee2d5f599642788c32e0d8b8338c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e7d531c0f4a33a869309af965e3e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:48.495148 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-aede53cc-fee1-4dd5-a0c9-2876fba0ab58 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] 10.222.0.52 "GET /compute/v2.1/servers/ae78bc7d-2e36-42d6-bcef-686291983088" status: 200 len: 1362 microversion: 2.1 time: 0.161875 Oct 28 09:51:48.495854 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 315/638] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:51:48 2022] GET /compute/v2.1/servers/ae78bc7d-2e36-42d6-bcef-686291983088 => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:48.534248 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [req-464154c8-ebe0-481a-af03-66c1e5087475 req-7884f9e8-c90e-43c9-a242-02bf5ae72a15 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae78bc7d-2e36-42d6-bcef-686291983088", "tag": "ae9bf3c2-16e5-43fd-adc5-89f48a0f6425"}]} {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:51:48.547047 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-464154c8-ebe0-481a-af03-66c1e5087475 req-7884f9e8-c90e-43c9-a242-02bf5ae72a15 service nova] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:48.547623 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-464154c8-ebe0-481a-af03-66c1e5087475 req-7884f9e8-c90e-43c9-a242-02bf5ae72a15 service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:48.548142 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-464154c8-ebe0-481a-af03-66c1e5087475 req-7884f9e8-c90e-43c9-a242-02bf5ae72a15 service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:48.560477 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.compute.server_external_events [req-464154c8-ebe0-481a-af03-66c1e5087475 req-7884f9e8-c90e-43c9-a242-02bf5ae72a15 service nova] Creating event network-changed:ae9bf3c2-16e5-43fd-adc5-89f48a0f6425 for instance ae78bc7d-2e36-42d6-bcef-686291983088 on hv-cinder-zed-3 Oct 28 09:51:48.565626 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [req-464154c8-ebe0-481a-af03-66c1e5087475 req-7884f9e8-c90e-43c9-a242-02bf5ae72a15 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035912 Oct 28 09:51:48.566327 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 324/639] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Oct 28 09:51:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:51:49.517974 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-bb72b9c8-6dbc-47a2-8f1d-c8a2effebcf9 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:49.518591 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-bb72b9c8-6dbc-47a2-8f1d-c8a2effebcf9 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] [instance: ae78bc7d-2e36-42d6-bcef-686291983088] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:51:49.524840 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-bb72b9c8-6dbc-47a2-8f1d-c8a2effebcf9 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:49.525384 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-bb72b9c8-6dbc-47a2-8f1d-c8a2effebcf9 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:49.525817 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-bb72b9c8-6dbc-47a2-8f1d-c8a2effebcf9 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:49.526513 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-bb72b9c8-6dbc-47a2-8f1d-c8a2effebcf9 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:49.526970 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-bb72b9c8-6dbc-47a2-8f1d-c8a2effebcf9 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:49.527420 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-bb72b9c8-6dbc-47a2-8f1d-c8a2effebcf9 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:49.662443 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-bb72b9c8-6dbc-47a2-8f1d-c8a2effebcf9 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bee2d5f599642788c32e0d8b8338c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e7d531c0f4a33a869309af965e3e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:49.670155 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-bb72b9c8-6dbc-47a2-8f1d-c8a2effebcf9 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] 10.222.0.52 "GET /compute/v2.1/servers/ae78bc7d-2e36-42d6-bcef-686291983088" status: 200 len: 1362 microversion: 2.1 time: 0.156335 Oct 28 09:51:49.670721 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 316/640] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:51:49 2022] GET /compute/v2.1/servers/ae78bc7d-2e36-42d6-bcef-686291983088 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:50.694101 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-3ff0fd12-7839-4ff8-b098-f9a36d1f0b38 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:50.694851 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-3ff0fd12-7839-4ff8-b098-f9a36d1f0b38 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] [instance: ae78bc7d-2e36-42d6-bcef-686291983088] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:51:50.701919 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-3ff0fd12-7839-4ff8-b098-f9a36d1f0b38 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:50.702410 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-3ff0fd12-7839-4ff8-b098-f9a36d1f0b38 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:50.702844 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-3ff0fd12-7839-4ff8-b098-f9a36d1f0b38 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:50.703554 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-3ff0fd12-7839-4ff8-b098-f9a36d1f0b38 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:50.704032 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-3ff0fd12-7839-4ff8-b098-f9a36d1f0b38 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:50.704451 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-3ff0fd12-7839-4ff8-b098-f9a36d1f0b38 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:50.845775 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-3ff0fd12-7839-4ff8-b098-f9a36d1f0b38 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bee2d5f599642788c32e0d8b8338c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e7d531c0f4a33a869309af965e3e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:50.853670 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-3ff0fd12-7839-4ff8-b098-f9a36d1f0b38 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] 10.222.0.52 "GET /compute/v2.1/servers/ae78bc7d-2e36-42d6-bcef-686291983088" status: 200 len: 1362 microversion: 2.1 time: 0.164423 Oct 28 09:51:50.854258 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 325/641] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:51:50 2022] GET /compute/v2.1/servers/ae78bc7d-2e36-42d6-bcef-686291983088 => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:51.879353 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-564335cc-0f20-4952-a76f-76556b3d4d49 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:51.880005 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-564335cc-0f20-4952-a76f-76556b3d4d49 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] [instance: ae78bc7d-2e36-42d6-bcef-686291983088] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:51:51.886553 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-564335cc-0f20-4952-a76f-76556b3d4d49 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:51.887042 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-564335cc-0f20-4952-a76f-76556b3d4d49 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:51.887478 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-564335cc-0f20-4952-a76f-76556b3d4d49 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:51.888249 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-564335cc-0f20-4952-a76f-76556b3d4d49 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:51.888668 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-564335cc-0f20-4952-a76f-76556b3d4d49 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:51.889107 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-564335cc-0f20-4952-a76f-76556b3d4d49 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:52.023501 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-564335cc-0f20-4952-a76f-76556b3d4d49 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bee2d5f599642788c32e0d8b8338c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e7d531c0f4a33a869309af965e3e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:52.031269 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-564335cc-0f20-4952-a76f-76556b3d4d49 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] 10.222.0.52 "GET /compute/v2.1/servers/ae78bc7d-2e36-42d6-bcef-686291983088" status: 200 len: 1362 microversion: 2.1 time: 0.155827 Oct 28 09:51:52.031873 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 317/642] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:51:51 2022] GET /compute/v2.1/servers/ae78bc7d-2e36-42d6-bcef-686291983088 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:53.054496 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-f9718564-f11b-495a-b441-a4a969a161e6 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:53.055068 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-f9718564-f11b-495a-b441-a4a969a161e6 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] [instance: ae78bc7d-2e36-42d6-bcef-686291983088] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:51:53.057140 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG dbcounter [-] [127032] Writing DB stats nova_cell0:SELECT=2 {{(pid=127032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:53.062923 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-f9718564-f11b-495a-b441-a4a969a161e6 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:53.063409 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-f9718564-f11b-495a-b441-a4a969a161e6 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:53.063864 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-f9718564-f11b-495a-b441-a4a969a161e6 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:53.064564 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-f9718564-f11b-495a-b441-a4a969a161e6 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:53.065013 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-f9718564-f11b-495a-b441-a4a969a161e6 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:53.065433 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-f9718564-f11b-495a-b441-a4a969a161e6 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:53.202195 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-f9718564-f11b-495a-b441-a4a969a161e6 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bee2d5f599642788c32e0d8b8338c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e7d531c0f4a33a869309af965e3e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:53.209883 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-f9718564-f11b-495a-b441-a4a969a161e6 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] 10.222.0.52 "GET /compute/v2.1/servers/ae78bc7d-2e36-42d6-bcef-686291983088" status: 200 len: 1362 microversion: 2.1 time: 0.159380 Oct 28 09:51:53.210456 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 326/643] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:51:53 2022] GET /compute/v2.1/servers/ae78bc7d-2e36-42d6-bcef-686291983088 => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:54.232884 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-23772b82-3113-4283-b06f-5768808f6013 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:54.233496 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-23772b82-3113-4283-b06f-5768808f6013 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] [instance: ae78bc7d-2e36-42d6-bcef-686291983088] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:51:54.236055 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG dbcounter [-] [127033] Writing DB stats nova_cell0:SELECT=8 {{(pid=127033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:54.241887 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-23772b82-3113-4283-b06f-5768808f6013 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:54.242380 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-23772b82-3113-4283-b06f-5768808f6013 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:54.242823 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-23772b82-3113-4283-b06f-5768808f6013 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:54.243522 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-23772b82-3113-4283-b06f-5768808f6013 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:54.244172 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-23772b82-3113-4283-b06f-5768808f6013 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:54.244606 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-23772b82-3113-4283-b06f-5768808f6013 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:54.378047 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-23772b82-3113-4283-b06f-5768808f6013 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bee2d5f599642788c32e0d8b8338c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e7d531c0f4a33a869309af965e3e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:54.386902 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-23772b82-3113-4283-b06f-5768808f6013 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] 10.222.0.52 "GET /compute/v2.1/servers/ae78bc7d-2e36-42d6-bcef-686291983088" status: 200 len: 1362 microversion: 2.1 time: 0.157876 Oct 28 09:51:54.387495 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 318/644] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:51:54 2022] GET /compute/v2.1/servers/ae78bc7d-2e36-42d6-bcef-686291983088 => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:51:55.410633 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-3da6cdd9-d8c7-49d5-88ec-08a43cc28b85 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:55.411191 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-3da6cdd9-d8c7-49d5-88ec-08a43cc28b85 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] [instance: ae78bc7d-2e36-42d6-bcef-686291983088] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:51:55.414337 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG dbcounter [-] [127032] Writing DB stats nova_cell0:SELECT=10 {{(pid=127032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:55.420058 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-3da6cdd9-d8c7-49d5-88ec-08a43cc28b85 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:55.420556 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-3da6cdd9-d8c7-49d5-88ec-08a43cc28b85 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:55.420996 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-3da6cdd9-d8c7-49d5-88ec-08a43cc28b85 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:55.421740 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-3da6cdd9-d8c7-49d5-88ec-08a43cc28b85 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:55.422195 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-3da6cdd9-d8c7-49d5-88ec-08a43cc28b85 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:55.422625 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-3da6cdd9-d8c7-49d5-88ec-08a43cc28b85 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:55.580952 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-3da6cdd9-d8c7-49d5-88ec-08a43cc28b85 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bee2d5f599642788c32e0d8b8338c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e7d531c0f4a33a869309af965e3e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:55.589417 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-3da6cdd9-d8c7-49d5-88ec-08a43cc28b85 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] 10.222.0.52 "GET /compute/v2.1/servers/ae78bc7d-2e36-42d6-bcef-686291983088" status: 200 len: 1362 microversion: 2.1 time: 0.182696 Oct 28 09:51:55.590011 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 327/645] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:51:55 2022] GET /compute/v2.1/servers/ae78bc7d-2e36-42d6-bcef-686291983088 => generated 1362 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:56.024996 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [req-2cec5d01-f912-454f-96fc-13a138186f5b req-af4dcc2f-0d82-4542-8f1e-4d2c126b919f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae78bc7d-2e36-42d6-bcef-686291983088", "name": "network-vif-plugged", "status": "completed", "tag": "ae9bf3c2-16e5-43fd-adc5-89f48a0f6425"}]} {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:51:56.036542 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-2cec5d01-f912-454f-96fc-13a138186f5b req-af4dcc2f-0d82-4542-8f1e-4d2c126b919f service nova] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:56.036996 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-2cec5d01-f912-454f-96fc-13a138186f5b req-af4dcc2f-0d82-4542-8f1e-4d2c126b919f service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:56.037427 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-2cec5d01-f912-454f-96fc-13a138186f5b req-af4dcc2f-0d82-4542-8f1e-4d2c126b919f service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:56.050682 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.compute.server_external_events [req-2cec5d01-f912-454f-96fc-13a138186f5b req-af4dcc2f-0d82-4542-8f1e-4d2c126b919f service nova] Creating event network-vif-plugged:ae9bf3c2-16e5-43fd-adc5-89f48a0f6425 for instance ae78bc7d-2e36-42d6-bcef-686291983088 on hv-cinder-zed-3 Oct 28 09:51:56.057308 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [req-2cec5d01-f912-454f-96fc-13a138186f5b req-af4dcc2f-0d82-4542-8f1e-4d2c126b919f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036080 Oct 28 09:51:56.057933 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 319/646] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Oct 28 09:51:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 09:51:56.616346 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-0c718514-5e8f-4b7e-b55c-1212c4f9207b tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:56.616958 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-0c718514-5e8f-4b7e-b55c-1212c4f9207b tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] [instance: ae78bc7d-2e36-42d6-bcef-686291983088] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:51:56.623393 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-0c718514-5e8f-4b7e-b55c-1212c4f9207b tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:56.623957 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-0c718514-5e8f-4b7e-b55c-1212c4f9207b tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:56.624393 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-0c718514-5e8f-4b7e-b55c-1212c4f9207b tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:56.625079 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-0c718514-5e8f-4b7e-b55c-1212c4f9207b tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:56.625538 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-0c718514-5e8f-4b7e-b55c-1212c4f9207b tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:56.625959 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-0c718514-5e8f-4b7e-b55c-1212c4f9207b tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:56.771626 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-0c718514-5e8f-4b7e-b55c-1212c4f9207b tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bee2d5f599642788c32e0d8b8338c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e7d531c0f4a33a869309af965e3e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:56.779906 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-0c718514-5e8f-4b7e-b55c-1212c4f9207b tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] 10.222.0.52 "GET /compute/v2.1/servers/ae78bc7d-2e36-42d6-bcef-686291983088" status: 200 len: 1362 microversion: 2.1 time: 0.167654 Oct 28 09:51:56.780519 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 328/647] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:51:56 2022] GET /compute/v2.1/servers/ae78bc7d-2e36-42d6-bcef-686291983088 => generated 1362 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:57.805245 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-2aad5eef-cbcf-4f4d-a086-e498bca790d8 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:57.805951 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-2aad5eef-cbcf-4f4d-a086-e498bca790d8 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] [instance: ae78bc7d-2e36-42d6-bcef-686291983088] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:51:57.812275 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-2aad5eef-cbcf-4f4d-a086-e498bca790d8 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:57.812767 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-2aad5eef-cbcf-4f4d-a086-e498bca790d8 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:57.813202 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-2aad5eef-cbcf-4f4d-a086-e498bca790d8 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:57.813906 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-2aad5eef-cbcf-4f4d-a086-e498bca790d8 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:57.814377 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-2aad5eef-cbcf-4f4d-a086-e498bca790d8 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:57.814800 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-2aad5eef-cbcf-4f4d-a086-e498bca790d8 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:57.953060 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-2aad5eef-cbcf-4f4d-a086-e498bca790d8 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bee2d5f599642788c32e0d8b8338c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e7d531c0f4a33a869309af965e3e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:57.961473 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-2aad5eef-cbcf-4f4d-a086-e498bca790d8 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] 10.222.0.52 "GET /compute/v2.1/servers/ae78bc7d-2e36-42d6-bcef-686291983088" status: 200 len: 1362 microversion: 2.1 time: 0.161230 Oct 28 09:51:57.962060 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 320/648] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:51:57 2022] GET /compute/v2.1/servers/ae78bc7d-2e36-42d6-bcef-686291983088 => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:58.987947 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-70287ed3-c2b2-47d8-8574-7cde1988cee7 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:58.989594 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-70287ed3-c2b2-47d8-8574-7cde1988cee7 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] [instance: ae78bc7d-2e36-42d6-bcef-686291983088] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:51:58.998891 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-70287ed3-c2b2-47d8-8574-7cde1988cee7 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:58.999459 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-70287ed3-c2b2-47d8-8574-7cde1988cee7 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:59.000006 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-70287ed3-c2b2-47d8-8574-7cde1988cee7 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:59.000953 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-70287ed3-c2b2-47d8-8574-7cde1988cee7 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:59.001743 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-70287ed3-c2b2-47d8-8574-7cde1988cee7 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:59.002514 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-70287ed3-c2b2-47d8-8574-7cde1988cee7 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:59.153969 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-70287ed3-c2b2-47d8-8574-7cde1988cee7 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bee2d5f599642788c32e0d8b8338c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e7d531c0f4a33a869309af965e3e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:59.162366 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-70287ed3-c2b2-47d8-8574-7cde1988cee7 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] 10.222.0.52 "GET /compute/v2.1/servers/ae78bc7d-2e36-42d6-bcef-686291983088" status: 200 len: 1547 microversion: 2.1 time: 0.181404 Oct 28 09:51:59.162948 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 329/649] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:51:58 2022] GET /compute/v2.1/servers/ae78bc7d-2e36-42d6-bcef-686291983088 => generated 1547 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:51:59.184586 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-44253620-7073-4715-9577-438b9323a0f5 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:59.185215 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-44253620-7073-4715-9577-438b9323a0f5 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] [instance: ae78bc7d-2e36-42d6-bcef-686291983088] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:51:59.191668 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-44253620-7073-4715-9577-438b9323a0f5 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:59.192200 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-44253620-7073-4715-9577-438b9323a0f5 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:59.192637 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-44253620-7073-4715-9577-438b9323a0f5 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:59.193333 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-44253620-7073-4715-9577-438b9323a0f5 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:59.193791 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-44253620-7073-4715-9577-438b9323a0f5 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:59.194214 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-44253620-7073-4715-9577-438b9323a0f5 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:59.275985 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-44253620-7073-4715-9577-438b9323a0f5 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] 10.222.0.52 "GET /compute/v2.1/servers/ae78bc7d-2e36-42d6-bcef-686291983088/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095359 Oct 28 09:51:59.276595 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 321/650] 10.222.0.52 () {58 vars in 1275 bytes} [Fri Oct 28 09:51:59 2022] GET /compute/v2.1/servers/ae78bc7d-2e36-42d6-bcef-686291983088/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:52:00.519518 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [req-31495cb2-d1be-4681-ba5f-3265a4b4e798 req-b588d610-f4a0-488c-87e5-05802796087f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae78bc7d-2e36-42d6-bcef-686291983088", "tag": "ae9bf3c2-16e5-43fd-adc5-89f48a0f6425"}]} {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:52:00.529894 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-31495cb2-d1be-4681-ba5f-3265a4b4e798 req-b588d610-f4a0-488c-87e5-05802796087f service nova] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:00.530376 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-31495cb2-d1be-4681-ba5f-3265a4b4e798 req-b588d610-f4a0-488c-87e5-05802796087f service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:00.530808 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-31495cb2-d1be-4681-ba5f-3265a4b4e798 req-b588d610-f4a0-488c-87e5-05802796087f service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:00.541960 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.compute.server_external_events [req-31495cb2-d1be-4681-ba5f-3265a4b4e798 req-b588d610-f4a0-488c-87e5-05802796087f service nova] Creating event network-changed:ae9bf3c2-16e5-43fd-adc5-89f48a0f6425 for instance ae78bc7d-2e36-42d6-bcef-686291983088 on hv-cinder-zed-3 Oct 28 09:52:00.547047 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [req-31495cb2-d1be-4681-ba5f-3265a4b4e798 req-b588d610-f4a0-488c-87e5-05802796087f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031097 Oct 28 09:52:00.548437 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 330/651] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Oct 28 09:52:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:52:09.140264 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-57b735b3-040c-4ec6-bcc2-a7565eb6ff05 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:09.140833 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-57b735b3-040c-4ec6-bcc2-a7565eb6ff05 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: e6ddb7f9-7854-4aa1-a174-2048b9a40431] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:09.142892 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG dbcounter [-] [127033] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=1 {{(pid=127033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:52:09.150246 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-57b735b3-040c-4ec6-bcc2-a7565eb6ff05 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:09.150745 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-57b735b3-040c-4ec6-bcc2-a7565eb6ff05 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:09.151178 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-57b735b3-040c-4ec6-bcc2-a7565eb6ff05 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:09.151913 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-57b735b3-040c-4ec6-bcc2-a7565eb6ff05 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:09.152367 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-57b735b3-040c-4ec6-bcc2-a7565eb6ff05 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:09.152786 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-57b735b3-040c-4ec6-bcc2-a7565eb6ff05 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:09.156346 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG dbcounter [-] [127033] Writing DB stats nova_cell1:SELECT=59 {{(pid=127033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:52:09.244278 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.objects.instance [None req-57b735b3-040c-4ec6-bcc2-a7565eb6ff05 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lazy-loading 'services' on Instance uuid e6ddb7f9-7854-4aa1-a174-2048b9a40431 {{(pid=127033) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:52:09.325294 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-57b735b3-040c-4ec6-bcc2-a7565eb6ff05 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] 10.222.0.52 "DELETE /compute/v2.1/servers/e6ddb7f9-7854-4aa1-a174-2048b9a40431/os-volume_attachments/362a8b41-a268-4a64-80d2-ceea413a0440" status: 202 len: 0 microversion: 2.1 time: 0.189804 Oct 28 09:52:09.326150 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 322/652] 10.222.0.52 () {58 vars in 1416 bytes} [Fri Oct 28 09:52:09 2022] DELETE /compute/v2.1/servers/e6ddb7f9-7854-4aa1-a174-2048b9a40431/os-volume_attachments/362a8b41-a268-4a64-80d2-ceea413a0440 => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:52:09.335632 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-8f3151de-cc32-4c92-bb2e-011b04e6eef2 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:09.338045 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-8f3151de-cc32-4c92-bb2e-011b04e6eef2 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: e6ddb7f9-7854-4aa1-a174-2048b9a40431] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:09.340535 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG dbcounter [-] [127032] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:52:09.346424 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-8f3151de-cc32-4c92-bb2e-011b04e6eef2 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:09.346925 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-8f3151de-cc32-4c92-bb2e-011b04e6eef2 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:09.347450 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-8f3151de-cc32-4c92-bb2e-011b04e6eef2 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:09.348191 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-8f3151de-cc32-4c92-bb2e-011b04e6eef2 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:09.348797 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-8f3151de-cc32-4c92-bb2e-011b04e6eef2 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:09.349072 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-8f3151de-cc32-4c92-bb2e-011b04e6eef2 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:09.352705 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG dbcounter [-] [127032] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:52:09.386503 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-8f3151de-cc32-4c92-bb2e-011b04e6eef2 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] 10.222.0.52 "GET /compute/v2.1/servers/e6ddb7f9-7854-4aa1-a174-2048b9a40431/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055310 Oct 28 09:52:09.387196 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 331/653] 10.222.0.52 () {58 vars in 1302 bytes} [Fri Oct 28 09:52:09 2022] GET /compute/v2.1/servers/e6ddb7f9-7854-4aa1-a174-2048b9a40431/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 09:52:10.400239 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-b3407cc9-7164-455e-92cd-9c598e8d39ca tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:10.402567 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-b3407cc9-7164-455e-92cd-9c598e8d39ca tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: e6ddb7f9-7854-4aa1-a174-2048b9a40431] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:10.409551 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-b3407cc9-7164-455e-92cd-9c598e8d39ca tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:10.410076 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-b3407cc9-7164-455e-92cd-9c598e8d39ca tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:10.410543 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-b3407cc9-7164-455e-92cd-9c598e8d39ca tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:10.411256 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-b3407cc9-7164-455e-92cd-9c598e8d39ca tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:10.411711 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-b3407cc9-7164-455e-92cd-9c598e8d39ca tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:10.412199 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-b3407cc9-7164-455e-92cd-9c598e8d39ca tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:10.443938 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-b3407cc9-7164-455e-92cd-9c598e8d39ca tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] 10.222.0.52 "GET /compute/v2.1/servers/e6ddb7f9-7854-4aa1-a174-2048b9a40431/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048342 Oct 28 09:52:10.444530 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 323/654] 10.222.0.52 () {58 vars in 1302 bytes} [Fri Oct 28 09:52:10 2022] GET /compute/v2.1/servers/e6ddb7f9-7854-4aa1-a174-2048b9a40431/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 09:52:10.522485 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-2a93dd83-c12d-4c78-8df4-8522a31a08c8 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:10.523049 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-2a93dd83-c12d-4c78-8df4-8522a31a08c8 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: e6ddb7f9-7854-4aa1-a174-2048b9a40431] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:10.529600 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-2a93dd83-c12d-4c78-8df4-8522a31a08c8 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:10.530089 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-2a93dd83-c12d-4c78-8df4-8522a31a08c8 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:10.530526 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-2a93dd83-c12d-4c78-8df4-8522a31a08c8 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:10.531230 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-2a93dd83-c12d-4c78-8df4-8522a31a08c8 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:10.531688 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-2a93dd83-c12d-4c78-8df4-8522a31a08c8 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:10.532144 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-2a93dd83-c12d-4c78-8df4-8522a31a08c8 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:10.558968 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-2a93dd83-c12d-4c78-8df4-8522a31a08c8 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: e6ddb7f9-7854-4aa1-a174-2048b9a40431] Going to try to terminate instance {{(pid=127032) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 09:52:10.638626 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-2a93dd83-c12d-4c78-8df4-8522a31a08c8 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] 10.222.0.52 "DELETE /compute/v2.1/servers/e6ddb7f9-7854-4aa1-a174-2048b9a40431" status: 204 len: 0 microversion: 2.1 time: 0.120545 Oct 28 09:52:10.639585 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 332/655] 10.222.0.52 () {58 vars in 1239 bytes} [Fri Oct 28 09:52:10 2022] DELETE /compute/v2.1/servers/e6ddb7f9-7854-4aa1-a174-2048b9a40431 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 09:52:10.648170 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-c42c2b21-8820-4b33-bfa8-7ea221fc790c tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:10.648777 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-c42c2b21-8820-4b33-bfa8-7ea221fc790c tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: e6ddb7f9-7854-4aa1-a174-2048b9a40431] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:10.654801 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-c42c2b21-8820-4b33-bfa8-7ea221fc790c tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:10.655216 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-c42c2b21-8820-4b33-bfa8-7ea221fc790c tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:10.655653 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-c42c2b21-8820-4b33-bfa8-7ea221fc790c tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:10.656379 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-c42c2b21-8820-4b33-bfa8-7ea221fc790c tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:10.656832 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-c42c2b21-8820-4b33-bfa8-7ea221fc790c tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:10.657254 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-c42c2b21-8820-4b33-bfa8-7ea221fc790c tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:10.787799 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-c42c2b21-8820-4b33-bfa8-7ea221fc790c tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe6eb38e8df492daaef5755ddea7773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234f69f21d7a456a9ab6a86c4ac2ede2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:10.795545 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-c42c2b21-8820-4b33-bfa8-7ea221fc790c tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] 10.222.0.52 "GET /compute/v2.1/servers/e6ddb7f9-7854-4aa1-a174-2048b9a40431" status: 200 len: 1690 microversion: 2.1 time: 0.151890 Oct 28 09:52:10.796148 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 324/656] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:52:10 2022] GET /compute/v2.1/servers/e6ddb7f9-7854-4aa1-a174-2048b9a40431 => generated 1690 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:11.820501 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-3b94a292-1c40-44f6-bb68-365b79188bc3 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:11.821198 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-3b94a292-1c40-44f6-bb68-365b79188bc3 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: e6ddb7f9-7854-4aa1-a174-2048b9a40431] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:11.827943 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-3b94a292-1c40-44f6-bb68-365b79188bc3 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:11.828364 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-3b94a292-1c40-44f6-bb68-365b79188bc3 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:11.828802 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-3b94a292-1c40-44f6-bb68-365b79188bc3 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:11.829504 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-3b94a292-1c40-44f6-bb68-365b79188bc3 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:11.829962 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-3b94a292-1c40-44f6-bb68-365b79188bc3 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:11.830388 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-3b94a292-1c40-44f6-bb68-365b79188bc3 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:11.967557 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-3b94a292-1c40-44f6-bb68-365b79188bc3 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe6eb38e8df492daaef5755ddea7773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234f69f21d7a456a9ab6a86c4ac2ede2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:11.975342 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-3b94a292-1c40-44f6-bb68-365b79188bc3 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] 10.222.0.52 "GET /compute/v2.1/servers/e6ddb7f9-7854-4aa1-a174-2048b9a40431" status: 200 len: 1690 microversion: 2.1 time: 0.159291 Oct 28 09:52:11.975929 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 333/657] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:52:11 2022] GET /compute/v2.1/servers/e6ddb7f9-7854-4aa1-a174-2048b9a40431 => generated 1690 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:12.999045 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-0ec2efb2-9478-4964-9162-70bb628701a2 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:12.999561 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-0ec2efb2-9478-4964-9162-70bb628701a2 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: e6ddb7f9-7854-4aa1-a174-2048b9a40431] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:13.006586 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-0ec2efb2-9478-4964-9162-70bb628701a2 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:13.007065 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-0ec2efb2-9478-4964-9162-70bb628701a2 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:13.007493 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-0ec2efb2-9478-4964-9162-70bb628701a2 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:13.008205 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-0ec2efb2-9478-4964-9162-70bb628701a2 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:13.008655 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-0ec2efb2-9478-4964-9162-70bb628701a2 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:13.009111 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-0ec2efb2-9478-4964-9162-70bb628701a2 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:13.136930 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-0ec2efb2-9478-4964-9162-70bb628701a2 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe6eb38e8df492daaef5755ddea7773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234f69f21d7a456a9ab6a86c4ac2ede2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:13.144682 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-0ec2efb2-9478-4964-9162-70bb628701a2 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] 10.222.0.52 "GET /compute/v2.1/servers/e6ddb7f9-7854-4aa1-a174-2048b9a40431" status: 200 len: 1690 microversion: 2.1 time: 0.149728 Oct 28 09:52:13.145449 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 325/658] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:52:12 2022] GET /compute/v2.1/servers/e6ddb7f9-7854-4aa1-a174-2048b9a40431 => generated 1690 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:14.169873 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-37a21578-3839-4556-80d1-caf11b418197 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:14.170460 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-37a21578-3839-4556-80d1-caf11b418197 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: e6ddb7f9-7854-4aa1-a174-2048b9a40431] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:14.177207 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-37a21578-3839-4556-80d1-caf11b418197 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:14.178202 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-37a21578-3839-4556-80d1-caf11b418197 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:14.178872 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-37a21578-3839-4556-80d1-caf11b418197 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:14.179850 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-37a21578-3839-4556-80d1-caf11b418197 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:14.180371 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-37a21578-3839-4556-80d1-caf11b418197 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:14.180860 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-37a21578-3839-4556-80d1-caf11b418197 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:14.316007 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-37a21578-3839-4556-80d1-caf11b418197 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe6eb38e8df492daaef5755ddea7773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234f69f21d7a456a9ab6a86c4ac2ede2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:14.323872 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-37a21578-3839-4556-80d1-caf11b418197 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] 10.222.0.52 "GET /compute/v2.1/servers/e6ddb7f9-7854-4aa1-a174-2048b9a40431" status: 200 len: 1690 microversion: 2.1 time: 0.158589 Oct 28 09:52:14.324460 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 334/659] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:52:14 2022] GET /compute/v2.1/servers/e6ddb7f9-7854-4aa1-a174-2048b9a40431 => generated 1690 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:15.347564 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-a0fcd9f9-e2ea-4e3d-ba44-0eb7d64ef81e tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:15.348188 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-a0fcd9f9-e2ea-4e3d-ba44-0eb7d64ef81e tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: e6ddb7f9-7854-4aa1-a174-2048b9a40431] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:15.355626 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-a0fcd9f9-e2ea-4e3d-ba44-0eb7d64ef81e tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:15.356159 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-a0fcd9f9-e2ea-4e3d-ba44-0eb7d64ef81e tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:15.356604 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-a0fcd9f9-e2ea-4e3d-ba44-0eb7d64ef81e tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:15.357462 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-a0fcd9f9-e2ea-4e3d-ba44-0eb7d64ef81e tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:15.357763 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-a0fcd9f9-e2ea-4e3d-ba44-0eb7d64ef81e tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:15.358184 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-a0fcd9f9-e2ea-4e3d-ba44-0eb7d64ef81e tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:15.396107 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [req-a190ddcc-9e72-42b1-80fa-5350424178e9 req-49ec6a61-46f8-4ad2-9a0e-738ad1ebece6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6ddb7f9-7854-4aa1-a174-2048b9a40431", "name": "network-vif-deleted", "tag": "02ec0bd8-060a-466c-b33b-8ecb3e609c46"}]} {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:52:15.409666 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-a190ddcc-9e72-42b1-80fa-5350424178e9 req-49ec6a61-46f8-4ad2-9a0e-738ad1ebece6 service nova] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:15.410488 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-a190ddcc-9e72-42b1-80fa-5350424178e9 req-49ec6a61-46f8-4ad2-9a0e-738ad1ebece6 service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:15.410988 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-a190ddcc-9e72-42b1-80fa-5350424178e9 req-49ec6a61-46f8-4ad2-9a0e-738ad1ebece6 service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:15.423262 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.compute.server_external_events [req-a190ddcc-9e72-42b1-80fa-5350424178e9 req-49ec6a61-46f8-4ad2-9a0e-738ad1ebece6 service nova] Creating event network-vif-deleted:02ec0bd8-060a-466c-b33b-8ecb3e609c46 for instance e6ddb7f9-7854-4aa1-a174-2048b9a40431 on hv-cinder-zed-3 Oct 28 09:52:15.428235 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [req-a190ddcc-9e72-42b1-80fa-5350424178e9 req-49ec6a61-46f8-4ad2-9a0e-738ad1ebece6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035589 Oct 28 09:52:15.437711 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 335/660] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Oct 28 09:52:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 09:52:15.437923 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-a0fcd9f9-e2ea-4e3d-ba44-0eb7d64ef81e tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe6eb38e8df492daaef5755ddea7773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234f69f21d7a456a9ab6a86c4ac2ede2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:15.443987 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-a0fcd9f9-e2ea-4e3d-ba44-0eb7d64ef81e tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] 10.222.0.52 "GET /compute/v2.1/servers/e6ddb7f9-7854-4aa1-a174-2048b9a40431" status: 200 len: 1622 microversion: 2.1 time: 0.100245 Oct 28 09:52:15.444560 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 326/661] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:52:15 2022] GET /compute/v2.1/servers/e6ddb7f9-7854-4aa1-a174-2048b9a40431 => generated 1622 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:16.469158 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-feccaeed-9e6d-4645-95bd-6afc6c20e2f9 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:16.470047 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-feccaeed-9e6d-4645-95bd-6afc6c20e2f9 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: e6ddb7f9-7854-4aa1-a174-2048b9a40431] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:16.476439 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-feccaeed-9e6d-4645-95bd-6afc6c20e2f9 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:16.476926 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-feccaeed-9e6d-4645-95bd-6afc6c20e2f9 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:16.477398 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-feccaeed-9e6d-4645-95bd-6afc6c20e2f9 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:16.478099 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-feccaeed-9e6d-4645-95bd-6afc6c20e2f9 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:16.478563 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-feccaeed-9e6d-4645-95bd-6afc6c20e2f9 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:16.479183 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-feccaeed-9e6d-4645-95bd-6afc6c20e2f9 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:16.493949 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.wsgi [None req-feccaeed-9e6d-4645-95bd-6afc6c20e2f9 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] HTTP exception thrown: Instance e6ddb7f9-7854-4aa1-a174-2048b9a40431 could not be found. Oct 28 09:52:16.495585 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-feccaeed-9e6d-4645-95bd-6afc6c20e2f9 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Request method failure captured: Oct 28 09:52:16.495585 dv-cinder-zed-3-smb devstack@n-api.service[127032]: request: GET /compute/v2.1/servers/e6ddb7f9-7854-4aa1-a174-2048b9a40431 HTTP/1.1 Oct 28 09:52:16.495585 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Accept: application/json Oct 28 09:52:16.495585 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Accept-Encoding: identity Oct 28 09:52:16.495585 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Connection: close Oct 28 09:52:16.495585 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Content-Length: 0 Oct 28 09:52:16.495585 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Content-Type: application/json Oct 28 09:52:16.495585 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Host: 10.222.0.52 Oct 28 09:52:16.495585 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Openstack-System-Scope: None Oct 28 09:52:16.495585 dv-cinder-zed-3-smb devstack@n-api.service[127032]: User-Agent: python-urllib3/1.26.12 Oct 28 09:52:16.495585 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Auth-Token: gAAAAABjW6UMBLZAcB4ofCUEvyoCWt-nTaXzdGXaOtWjwHccK7VrtFAzPPGWsQagqFaH1IBUrfHYI_AtqGoeSDCkxIRD0lzPZ7kumCvA3AUFB0eRrG8vOtKEHyKYUVg_hZG8huan0rPnrbQu2YqOny3faW5JsiVxHZMfNsP73PBj_XjtK1wa1N8 Oct 28 09:52:16.495585 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Domain-Id: None Oct 28 09:52:16.495585 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Domain-Name: None Oct 28 09:52:16.495585 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Identity-Status: Confirmed Oct 28 09:52:16.495585 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Is-Admin-Project: True Oct 28 09:52:16.495585 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Project-Domain-Id: default Oct 28 09:52:16.495585 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Project-Domain-Name: Default Oct 28 09:52:16.495585 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Project-Id: 234f69f21d7a456a9ab6a86c4ac2ede2 Oct 28 09:52:16.495585 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1058371291 Oct 28 09:52:16.495585 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Role: reader,member Oct 28 09:52:16.495585 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Roles: reader,member Oct 28 09:52:16.497012 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_234f69f21d7a456a9ab6a86c4ac2ede2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/234f69f21d7a456a9ab6a86c4ac2ede2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/234f69f21d7a456a9ab6a86c4ac2ede2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/234f69f21d7a456a9ab6a86c4ac2ede2"}]}] Oct 28 09:52:16.497012 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1058371291 Oct 28 09:52:16.497012 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Tenant-Id: 234f69f21d7a456a9ab6a86c4ac2ede2 Oct 28 09:52:16.497012 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1058371291 Oct 28 09:52:16.497012 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-User: tempest-ServerRescueNegativeTestJSON-1058371291-project Oct 28 09:52:16.497012 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-User-Domain-Id: default Oct 28 09:52:16.497012 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-User-Domain-Name: Default Oct 28 09:52:16.497012 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-User-Id: cfe6eb38e8df492daaef5755ddea7773 Oct 28 09:52:16.497012 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1058371291-project Oct 28 09:52:16.497012 dv-cinder-zed-3-smb devstack@n-api.service[127032]: method: > Oct 28 09:52:16.497012 dv-cinder-zed-3-smb devstack@n-api.service[127032]: exception: Instance e6ddb7f9-7854-4aa1-a174-2048b9a40431 could not be found. Oct 28 09:52:16.497012 dv-cinder-zed-3-smb devstack@n-api.service[127032]: action_args: {'id': 'e6ddb7f9-7854-4aa1-a174-2048b9a40431'} Oct 28 09:52:16.498351 dv-cinder-zed-3-smb devstack@n-api.service[127032]: {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:52:16.498351 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:52:16.498351 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 09:52:16.498351 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 09:52:16.498351 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 09:52:16.498351 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 09:52:16.498351 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 09:52:16.498351 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 09:52:16.498351 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 09:52:16.498351 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 09:52:16.498351 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6ddb7f9-7854-4aa1-a174-2048b9a40431 could not be found. Oct 28 09:52:16.498351 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Oct 28 09:52:16.498351 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:52:16.498351 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Oct 28 09:52:16.498351 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:52:16.498351 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:52:16.498351 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:52:16.498351 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:52:16.498351 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:52:16.498351 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:52:16.499688 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:52:16.499688 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 09:52:16.499688 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 09:52:16.499688 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 09:52:16.499688 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 09:52:16.499688 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 09:52:16.499688 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 09:52:16.499688 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6ddb7f9-7854-4aa1-a174-2048b9a40431 could not be found. Oct 28 09:52:16.499688 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Oct 28 09:52:16.499688 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:52:16.499688 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Oct 28 09:52:16.499688 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:52:16.499688 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:52:16.499688 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:52:16.499688 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:52:16.499688 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:52:16.499688 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6ddb7f9-7854-4aa1-a174-2048b9a40431 could not be found. Oct 28 09:52:16.499688 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Oct 28 09:52:16.501366 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-feccaeed-9e6d-4645-95bd-6afc6c20e2f9 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Returning 404 to user: Instance e6ddb7f9-7854-4aa1-a174-2048b9a40431 could not be found. {{(pid=127032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:52:16.501366 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-feccaeed-9e6d-4645-95bd-6afc6c20e2f9 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] 10.222.0.52 "GET /compute/v2.1/servers/e6ddb7f9-7854-4aa1-a174-2048b9a40431" status: 404 len: 111 microversion: 2.1 time: 0.032934 Oct 28 09:52:16.501366 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 336/662] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:52:16 2022] GET /compute/v2.1/servers/e6ddb7f9-7854-4aa1-a174-2048b9a40431 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:52:16.505915 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-e723cc0e-51b0-4756-8f62-d479eb89a648 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Calling method '.version_select at 0x7ff010142940>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:16.525167 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-e723cc0e-51b0-4756-8f62-d479eb89a648 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1499224246" status: 202 len: 0 microversion: 2.1 time: 0.023015 Oct 28 09:52:16.525744 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 327/663] 10.222.0.52 () {58 vars in 1221 bytes} [Fri Oct 28 09:52:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1499224246 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:52:19.407358 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-dab65712-fb1f-4a6f-a60b-65a2ee836c66 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:19.407948 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-dab65712-fb1f-4a6f-a60b-65a2ee836c66 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: 9705038a-caef-4cf0-ae5f-b6ebcb2dbea6] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:19.414320 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-dab65712-fb1f-4a6f-a60b-65a2ee836c66 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:19.414848 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-dab65712-fb1f-4a6f-a60b-65a2ee836c66 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:19.415868 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-dab65712-fb1f-4a6f-a60b-65a2ee836c66 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:19.416570 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-dab65712-fb1f-4a6f-a60b-65a2ee836c66 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:19.417025 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-dab65712-fb1f-4a6f-a60b-65a2ee836c66 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:19.417447 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-dab65712-fb1f-4a6f-a60b-65a2ee836c66 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:19.445297 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-dab65712-fb1f-4a6f-a60b-65a2ee836c66 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: 9705038a-caef-4cf0-ae5f-b6ebcb2dbea6] Going to try to terminate instance {{(pid=127032) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 09:52:19.523317 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-dab65712-fb1f-4a6f-a60b-65a2ee836c66 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] 10.222.0.52 "DELETE /compute/v2.1/servers/9705038a-caef-4cf0-ae5f-b6ebcb2dbea6" status: 204 len: 0 microversion: 2.1 time: 0.119481 Oct 28 09:52:19.526343 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 337/664] 10.222.0.52 () {58 vars in 1239 bytes} [Fri Oct 28 09:52:19 2022] DELETE /compute/v2.1/servers/9705038a-caef-4cf0-ae5f-b6ebcb2dbea6 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 09:52:19.534383 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-35143c11-0d6b-4c2e-9931-0c8b0b9bf784 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:19.535154 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-35143c11-0d6b-4c2e-9931-0c8b0b9bf784 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: 9705038a-caef-4cf0-ae5f-b6ebcb2dbea6] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:19.542329 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-35143c11-0d6b-4c2e-9931-0c8b0b9bf784 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:19.542812 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-35143c11-0d6b-4c2e-9931-0c8b0b9bf784 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:19.543247 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-35143c11-0d6b-4c2e-9931-0c8b0b9bf784 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:19.543972 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-35143c11-0d6b-4c2e-9931-0c8b0b9bf784 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:19.544429 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-35143c11-0d6b-4c2e-9931-0c8b0b9bf784 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:19.544852 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-35143c11-0d6b-4c2e-9931-0c8b0b9bf784 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:19.681236 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-35143c11-0d6b-4c2e-9931-0c8b0b9bf784 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe6eb38e8df492daaef5755ddea7773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234f69f21d7a456a9ab6a86c4ac2ede2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:19.689271 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-35143c11-0d6b-4c2e-9931-0c8b0b9bf784 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] 10.222.0.52 "GET /compute/v2.1/servers/9705038a-caef-4cf0-ae5f-b6ebcb2dbea6" status: 200 len: 1507 microversion: 2.1 time: 0.160047 Oct 28 09:52:19.689840 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 328/665] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:52:19 2022] GET /compute/v2.1/servers/9705038a-caef-4cf0-ae5f-b6ebcb2dbea6 => generated 1507 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:20.714326 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-6b48ff55-a6b1-4a50-be92-d5e4d3349dcb tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:20.715025 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-6b48ff55-a6b1-4a50-be92-d5e4d3349dcb tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: 9705038a-caef-4cf0-ae5f-b6ebcb2dbea6] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:20.721739 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-6b48ff55-a6b1-4a50-be92-d5e4d3349dcb tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:20.722222 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-6b48ff55-a6b1-4a50-be92-d5e4d3349dcb tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:20.722656 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-6b48ff55-a6b1-4a50-be92-d5e4d3349dcb tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:20.723360 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-6b48ff55-a6b1-4a50-be92-d5e4d3349dcb tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:20.723835 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-6b48ff55-a6b1-4a50-be92-d5e4d3349dcb tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:20.724262 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-6b48ff55-a6b1-4a50-be92-d5e4d3349dcb tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:20.864959 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-6b48ff55-a6b1-4a50-be92-d5e4d3349dcb tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe6eb38e8df492daaef5755ddea7773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234f69f21d7a456a9ab6a86c4ac2ede2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:20.873838 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-6b48ff55-a6b1-4a50-be92-d5e4d3349dcb tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] 10.222.0.52 "GET /compute/v2.1/servers/9705038a-caef-4cf0-ae5f-b6ebcb2dbea6" status: 200 len: 1507 microversion: 2.1 time: 0.164371 Oct 28 09:52:20.874415 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 338/666] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:52:20 2022] GET /compute/v2.1/servers/9705038a-caef-4cf0-ae5f-b6ebcb2dbea6 => generated 1507 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:52:21.897784 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-0c4160ed-f81d-40ae-bff0-2bcbada2f853 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:21.898319 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-0c4160ed-f81d-40ae-bff0-2bcbada2f853 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: 9705038a-caef-4cf0-ae5f-b6ebcb2dbea6] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:21.904816 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-0c4160ed-f81d-40ae-bff0-2bcbada2f853 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:21.905295 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-0c4160ed-f81d-40ae-bff0-2bcbada2f853 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:21.905736 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-0c4160ed-f81d-40ae-bff0-2bcbada2f853 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:21.906435 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-0c4160ed-f81d-40ae-bff0-2bcbada2f853 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:21.906900 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-0c4160ed-f81d-40ae-bff0-2bcbada2f853 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:21.907326 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-0c4160ed-f81d-40ae-bff0-2bcbada2f853 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:21.976042 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-0c4160ed-f81d-40ae-bff0-2bcbada2f853 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe6eb38e8df492daaef5755ddea7773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234f69f21d7a456a9ab6a86c4ac2ede2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:21.986539 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-0c4160ed-f81d-40ae-bff0-2bcbada2f853 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] 10.222.0.52 "GET /compute/v2.1/servers/9705038a-caef-4cf0-ae5f-b6ebcb2dbea6" status: 200 len: 1465 microversion: 2.1 time: 0.093356 Oct 28 09:52:21.987622 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 329/667] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:52:21 2022] GET /compute/v2.1/servers/9705038a-caef-4cf0-ae5f-b6ebcb2dbea6 => generated 1465 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:21.996392 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [req-1d90981a-2fa5-4669-9db4-aa9bf92a2042 req-dcdf7c85-72ff-4962-9ccb-ce9df6fd4e59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9705038a-caef-4cf0-ae5f-b6ebcb2dbea6", "name": "network-vif-deleted", "tag": "13abc86d-9c0f-4501-ac09-79754e63f048"}]} {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:52:22.018467 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-1d90981a-2fa5-4669-9db4-aa9bf92a2042 req-dcdf7c85-72ff-4962-9ccb-ce9df6fd4e59 service nova] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:22.018951 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-1d90981a-2fa5-4669-9db4-aa9bf92a2042 req-dcdf7c85-72ff-4962-9ccb-ce9df6fd4e59 service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:22.019385 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-1d90981a-2fa5-4669-9db4-aa9bf92a2042 req-dcdf7c85-72ff-4962-9ccb-ce9df6fd4e59 service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:22.031837 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.compute.server_external_events [req-1d90981a-2fa5-4669-9db4-aa9bf92a2042 req-dcdf7c85-72ff-4962-9ccb-ce9df6fd4e59 service nova] Creating event network-vif-deleted:13abc86d-9c0f-4501-ac09-79754e63f048 for instance 9705038a-caef-4cf0-ae5f-b6ebcb2dbea6 on hv-cinder-zed-3 Oct 28 09:52:22.037399 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [req-1d90981a-2fa5-4669-9db4-aa9bf92a2042 req-dcdf7c85-72ff-4962-9ccb-ce9df6fd4e59 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045239 Oct 28 09:52:22.038261 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 339/668] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Oct 28 09:52:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:52:23.011068 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-7fc3eedc-22e9-4c0f-8860-e18e46affa89 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:23.011673 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-7fc3eedc-22e9-4c0f-8860-e18e46affa89 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: 9705038a-caef-4cf0-ae5f-b6ebcb2dbea6] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:23.018871 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-7fc3eedc-22e9-4c0f-8860-e18e46affa89 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:23.019695 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-7fc3eedc-22e9-4c0f-8860-e18e46affa89 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:23.020236 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-7fc3eedc-22e9-4c0f-8860-e18e46affa89 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:23.020965 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-7fc3eedc-22e9-4c0f-8860-e18e46affa89 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:23.021512 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-7fc3eedc-22e9-4c0f-8860-e18e46affa89 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:23.022023 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-7fc3eedc-22e9-4c0f-8860-e18e46affa89 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:23.058025 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-7fc3eedc-22e9-4c0f-8860-e18e46affa89 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:23.058505 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-7fc3eedc-22e9-4c0f-8860-e18e46affa89 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:23.058939 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-7fc3eedc-22e9-4c0f-8860-e18e46affa89 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:23.059375 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.objects.instance [None req-7fc3eedc-22e9-4c0f-8860-e18e46affa89 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lazy-loading 'fault' on Instance uuid 9705038a-caef-4cf0-ae5f-b6ebcb2dbea6 {{(pid=127033) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:52:23.100892 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-7fc3eedc-22e9-4c0f-8860-e18e46affa89 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe6eb38e8df492daaef5755ddea7773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234f69f21d7a456a9ab6a86c4ac2ede2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:23.108851 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-7fc3eedc-22e9-4c0f-8860-e18e46affa89 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] 10.222.0.52 "GET /compute/v2.1/servers/9705038a-caef-4cf0-ae5f-b6ebcb2dbea6" status: 200 len: 1311 microversion: 2.1 time: 0.102202 Oct 28 09:52:23.109534 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 330/669] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:52:23 2022] GET /compute/v2.1/servers/9705038a-caef-4cf0-ae5f-b6ebcb2dbea6 => generated 1311 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:24.134010 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-cd5340b8-c099-469e-8ece-e50cb67939fd tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:24.134720 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-cd5340b8-c099-469e-8ece-e50cb67939fd tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: 9705038a-caef-4cf0-ae5f-b6ebcb2dbea6] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:24.140943 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-cd5340b8-c099-469e-8ece-e50cb67939fd tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:24.141446 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-cd5340b8-c099-469e-8ece-e50cb67939fd tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:24.141883 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-cd5340b8-c099-469e-8ece-e50cb67939fd tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:24.142586 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-cd5340b8-c099-469e-8ece-e50cb67939fd tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:24.143038 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-cd5340b8-c099-469e-8ece-e50cb67939fd tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:24.143462 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-cd5340b8-c099-469e-8ece-e50cb67939fd tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:24.157429 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.wsgi [None req-cd5340b8-c099-469e-8ece-e50cb67939fd tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] HTTP exception thrown: Instance 9705038a-caef-4cf0-ae5f-b6ebcb2dbea6 could not be found. Oct 28 09:52:24.159079 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-cd5340b8-c099-469e-8ece-e50cb67939fd tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Request method failure captured: Oct 28 09:52:24.159079 dv-cinder-zed-3-smb devstack@n-api.service[127032]: request: GET /compute/v2.1/servers/9705038a-caef-4cf0-ae5f-b6ebcb2dbea6 HTTP/1.1 Oct 28 09:52:24.159079 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Accept: application/json Oct 28 09:52:24.159079 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Accept-Encoding: identity Oct 28 09:52:24.159079 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Connection: close Oct 28 09:52:24.159079 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Content-Length: 0 Oct 28 09:52:24.159079 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Content-Type: application/json Oct 28 09:52:24.159079 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Host: 10.222.0.52 Oct 28 09:52:24.159079 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Openstack-System-Scope: None Oct 28 09:52:24.159079 dv-cinder-zed-3-smb devstack@n-api.service[127032]: User-Agent: python-urllib3/1.26.12 Oct 28 09:52:24.159079 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Auth-Token: gAAAAABjW6UMBLZAcB4ofCUEvyoCWt-nTaXzdGXaOtWjwHccK7VrtFAzPPGWsQagqFaH1IBUrfHYI_AtqGoeSDCkxIRD0lzPZ7kumCvA3AUFB0eRrG8vOtKEHyKYUVg_hZG8huan0rPnrbQu2YqOny3faW5JsiVxHZMfNsP73PBj_XjtK1wa1N8 Oct 28 09:52:24.159079 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Domain-Id: None Oct 28 09:52:24.159079 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Domain-Name: None Oct 28 09:52:24.159079 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Identity-Status: Confirmed Oct 28 09:52:24.159079 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Is-Admin-Project: True Oct 28 09:52:24.159079 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Project-Domain-Id: default Oct 28 09:52:24.159079 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Project-Domain-Name: Default Oct 28 09:52:24.159079 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Project-Id: 234f69f21d7a456a9ab6a86c4ac2ede2 Oct 28 09:52:24.159079 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1058371291 Oct 28 09:52:24.159079 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Role: reader,member Oct 28 09:52:24.159079 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Roles: reader,member Oct 28 09:52:24.160624 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_234f69f21d7a456a9ab6a86c4ac2ede2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/234f69f21d7a456a9ab6a86c4ac2ede2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/234f69f21d7a456a9ab6a86c4ac2ede2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/234f69f21d7a456a9ab6a86c4ac2ede2"}]}] Oct 28 09:52:24.160624 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1058371291 Oct 28 09:52:24.160624 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Tenant-Id: 234f69f21d7a456a9ab6a86c4ac2ede2 Oct 28 09:52:24.160624 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1058371291 Oct 28 09:52:24.160624 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-User: tempest-ServerRescueNegativeTestJSON-1058371291-project Oct 28 09:52:24.160624 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-User-Domain-Id: default Oct 28 09:52:24.160624 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-User-Domain-Name: Default Oct 28 09:52:24.160624 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-User-Id: cfe6eb38e8df492daaef5755ddea7773 Oct 28 09:52:24.160624 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1058371291-project Oct 28 09:52:24.160624 dv-cinder-zed-3-smb devstack@n-api.service[127032]: method: > Oct 28 09:52:24.160624 dv-cinder-zed-3-smb devstack@n-api.service[127032]: exception: Instance 9705038a-caef-4cf0-ae5f-b6ebcb2dbea6 could not be found. Oct 28 09:52:24.160624 dv-cinder-zed-3-smb devstack@n-api.service[127032]: action_args: {'id': '9705038a-caef-4cf0-ae5f-b6ebcb2dbea6'} Oct 28 09:52:24.161487 dv-cinder-zed-3-smb devstack@n-api.service[127032]: {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:52:24.161487 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:52:24.161487 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 09:52:24.161487 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 09:52:24.161487 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 09:52:24.161487 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 09:52:24.161487 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 09:52:24.161487 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 09:52:24.161487 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 09:52:24.161487 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 09:52:24.161487 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9705038a-caef-4cf0-ae5f-b6ebcb2dbea6 could not be found. Oct 28 09:52:24.161487 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Oct 28 09:52:24.161487 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:52:24.161487 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Oct 28 09:52:24.161487 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:52:24.161487 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:52:24.161487 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:52:24.161487 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:52:24.161487 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:52:24.161487 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:52:24.162817 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:52:24.162817 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 09:52:24.162817 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 09:52:24.162817 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 09:52:24.162817 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 09:52:24.162817 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 09:52:24.162817 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 09:52:24.162817 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9705038a-caef-4cf0-ae5f-b6ebcb2dbea6 could not be found. Oct 28 09:52:24.162817 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Oct 28 09:52:24.162817 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:52:24.162817 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Oct 28 09:52:24.162817 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:52:24.162817 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:52:24.162817 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:52:24.162817 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:52:24.162817 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:52:24.162817 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9705038a-caef-4cf0-ae5f-b6ebcb2dbea6 could not be found. Oct 28 09:52:24.162817 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Oct 28 09:52:24.164012 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-cd5340b8-c099-469e-8ece-e50cb67939fd tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Returning 404 to user: Instance 9705038a-caef-4cf0-ae5f-b6ebcb2dbea6 could not be found. {{(pid=127032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:52:24.164012 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-cd5340b8-c099-469e-8ece-e50cb67939fd tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] 10.222.0.52 "GET /compute/v2.1/servers/9705038a-caef-4cf0-ae5f-b6ebcb2dbea6" status: 404 len: 111 microversion: 2.1 time: 0.031312 Oct 28 09:52:24.164012 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 340/670] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:52:24 2022] GET /compute/v2.1/servers/9705038a-caef-4cf0-ae5f-b6ebcb2dbea6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:52:24.170317 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-459de86f-614c-46dd-ac7d-760e9ee1afdc tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:24.170835 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-459de86f-614c-46dd-ac7d-760e9ee1afdc tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: 1eaf7cc8-63d3-40c6-b5f5-e4e978ddfe17] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:24.177218 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-459de86f-614c-46dd-ac7d-760e9ee1afdc tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:24.177735 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-459de86f-614c-46dd-ac7d-760e9ee1afdc tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:24.178172 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-459de86f-614c-46dd-ac7d-760e9ee1afdc tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:24.178865 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-459de86f-614c-46dd-ac7d-760e9ee1afdc tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:24.179322 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-459de86f-614c-46dd-ac7d-760e9ee1afdc tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:24.179773 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-459de86f-614c-46dd-ac7d-760e9ee1afdc tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:24.207321 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-459de86f-614c-46dd-ac7d-760e9ee1afdc tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: 1eaf7cc8-63d3-40c6-b5f5-e4e978ddfe17] Going to try to terminate instance {{(pid=127033) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 09:52:24.281812 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-459de86f-614c-46dd-ac7d-760e9ee1afdc tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] 10.222.0.52 "DELETE /compute/v2.1/servers/1eaf7cc8-63d3-40c6-b5f5-e4e978ddfe17" status: 204 len: 0 microversion: 2.1 time: 0.115223 Oct 28 09:52:24.282401 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 331/671] 10.222.0.52 () {58 vars in 1239 bytes} [Fri Oct 28 09:52:24 2022] DELETE /compute/v2.1/servers/1eaf7cc8-63d3-40c6-b5f5-e4e978ddfe17 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 09:52:24.290340 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-d8094b77-88c0-4a41-a5af-ea80d84688ef tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:24.290946 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-d8094b77-88c0-4a41-a5af-ea80d84688ef tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: 1eaf7cc8-63d3-40c6-b5f5-e4e978ddfe17] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:24.296817 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-d8094b77-88c0-4a41-a5af-ea80d84688ef tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:24.297292 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-d8094b77-88c0-4a41-a5af-ea80d84688ef tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:24.297717 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-d8094b77-88c0-4a41-a5af-ea80d84688ef tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:24.298391 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-d8094b77-88c0-4a41-a5af-ea80d84688ef tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:24.298838 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-d8094b77-88c0-4a41-a5af-ea80d84688ef tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:24.299250 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-d8094b77-88c0-4a41-a5af-ea80d84688ef tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:24.429627 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-d8094b77-88c0-4a41-a5af-ea80d84688ef tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe6eb38e8df492daaef5755ddea7773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234f69f21d7a456a9ab6a86c4ac2ede2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:24.437894 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-d8094b77-88c0-4a41-a5af-ea80d84688ef tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] 10.222.0.52 "GET /compute/v2.1/servers/1eaf7cc8-63d3-40c6-b5f5-e4e978ddfe17" status: 200 len: 1522 microversion: 2.1 time: 0.151378 Oct 28 09:52:24.438474 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 341/672] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:52:24 2022] GET /compute/v2.1/servers/1eaf7cc8-63d3-40c6-b5f5-e4e978ddfe17 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:25.461519 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-12533871-3f41-4257-a71e-46dd914a7167 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:25.462728 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-12533871-3f41-4257-a71e-46dd914a7167 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: 1eaf7cc8-63d3-40c6-b5f5-e4e978ddfe17] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:25.470468 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-12533871-3f41-4257-a71e-46dd914a7167 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:25.470962 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-12533871-3f41-4257-a71e-46dd914a7167 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:25.471397 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-12533871-3f41-4257-a71e-46dd914a7167 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:25.472130 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-12533871-3f41-4257-a71e-46dd914a7167 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:25.472588 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-12533871-3f41-4257-a71e-46dd914a7167 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:25.473011 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-12533871-3f41-4257-a71e-46dd914a7167 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:25.601537 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-12533871-3f41-4257-a71e-46dd914a7167 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe6eb38e8df492daaef5755ddea7773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234f69f21d7a456a9ab6a86c4ac2ede2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:25.609245 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-12533871-3f41-4257-a71e-46dd914a7167 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] 10.222.0.52 "GET /compute/v2.1/servers/1eaf7cc8-63d3-40c6-b5f5-e4e978ddfe17" status: 200 len: 1522 microversion: 2.1 time: 0.152028 Oct 28 09:52:25.609840 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 332/673] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:52:25 2022] GET /compute/v2.1/servers/1eaf7cc8-63d3-40c6-b5f5-e4e978ddfe17 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:26.633052 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-f33038ca-51aa-459f-9c26-618cdd5eb45d tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:26.633651 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-f33038ca-51aa-459f-9c26-618cdd5eb45d tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: 1eaf7cc8-63d3-40c6-b5f5-e4e978ddfe17] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:26.640610 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-f33038ca-51aa-459f-9c26-618cdd5eb45d tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:26.641089 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-f33038ca-51aa-459f-9c26-618cdd5eb45d tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:26.641527 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-f33038ca-51aa-459f-9c26-618cdd5eb45d tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:26.642492 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-f33038ca-51aa-459f-9c26-618cdd5eb45d tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:26.642940 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-f33038ca-51aa-459f-9c26-618cdd5eb45d tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:26.643357 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-f33038ca-51aa-459f-9c26-618cdd5eb45d tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:26.774359 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-f33038ca-51aa-459f-9c26-618cdd5eb45d tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe6eb38e8df492daaef5755ddea7773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234f69f21d7a456a9ab6a86c4ac2ede2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:26.782714 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-f33038ca-51aa-459f-9c26-618cdd5eb45d tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] 10.222.0.52 "GET /compute/v2.1/servers/1eaf7cc8-63d3-40c6-b5f5-e4e978ddfe17" status: 200 len: 1522 microversion: 2.1 time: 0.153592 Oct 28 09:52:26.783287 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 342/674] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:52:26 2022] GET /compute/v2.1/servers/1eaf7cc8-63d3-40c6-b5f5-e4e978ddfe17 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:27.635896 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [req-c242f0a9-eedf-4b33-82fe-b4cc5a9bb708 req-ea098e19-5a2a-4ee7-aeaa-f48460485c00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1eaf7cc8-63d3-40c6-b5f5-e4e978ddfe17", "name": "network-vif-deleted", "tag": "598d1cbf-c937-4e8e-b9ab-10c22cbd11e8"}]} {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:52:27.647224 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-c242f0a9-eedf-4b33-82fe-b4cc5a9bb708 req-ea098e19-5a2a-4ee7-aeaa-f48460485c00 service nova] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:27.647704 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-c242f0a9-eedf-4b33-82fe-b4cc5a9bb708 req-ea098e19-5a2a-4ee7-aeaa-f48460485c00 service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:27.648164 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-c242f0a9-eedf-4b33-82fe-b4cc5a9bb708 req-ea098e19-5a2a-4ee7-aeaa-f48460485c00 service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:27.660057 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.compute.server_external_events [req-c242f0a9-eedf-4b33-82fe-b4cc5a9bb708 req-ea098e19-5a2a-4ee7-aeaa-f48460485c00 service nova] Creating event network-vif-deleted:598d1cbf-c937-4e8e-b9ab-10c22cbd11e8 for instance 1eaf7cc8-63d3-40c6-b5f5-e4e978ddfe17 on hv-cinder-zed-3 Oct 28 09:52:27.664921 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [req-c242f0a9-eedf-4b33-82fe-b4cc5a9bb708 req-ea098e19-5a2a-4ee7-aeaa-f48460485c00 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035665 Oct 28 09:52:27.666151 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 333/675] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Oct 28 09:52:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:52:27.805109 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-a98190b9-64ea-4006-81f8-ff1a35334df3 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:27.805733 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-a98190b9-64ea-4006-81f8-ff1a35334df3 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: 1eaf7cc8-63d3-40c6-b5f5-e4e978ddfe17] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:27.812463 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-a98190b9-64ea-4006-81f8-ff1a35334df3 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:27.813058 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-a98190b9-64ea-4006-81f8-ff1a35334df3 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:27.813364 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-a98190b9-64ea-4006-81f8-ff1a35334df3 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:27.814250 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-a98190b9-64ea-4006-81f8-ff1a35334df3 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:27.814708 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-a98190b9-64ea-4006-81f8-ff1a35334df3 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:27.815130 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-a98190b9-64ea-4006-81f8-ff1a35334df3 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:27.847223 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-a98190b9-64ea-4006-81f8-ff1a35334df3 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:27.847716 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-a98190b9-64ea-4006-81f8-ff1a35334df3 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:27.848188 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-a98190b9-64ea-4006-81f8-ff1a35334df3 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:27.848634 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.objects.instance [None req-a98190b9-64ea-4006-81f8-ff1a35334df3 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lazy-loading 'fault' on Instance uuid 1eaf7cc8-63d3-40c6-b5f5-e4e978ddfe17 {{(pid=127032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:52:27.889899 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-a98190b9-64ea-4006-81f8-ff1a35334df3 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe6eb38e8df492daaef5755ddea7773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '234f69f21d7a456a9ab6a86c4ac2ede2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:27.897733 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-a98190b9-64ea-4006-81f8-ff1a35334df3 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] 10.222.0.52 "GET /compute/v2.1/servers/1eaf7cc8-63d3-40c6-b5f5-e4e978ddfe17" status: 200 len: 1312 microversion: 2.1 time: 0.096556 Oct 28 09:52:27.898307 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 343/676] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:52:27 2022] GET /compute/v2.1/servers/1eaf7cc8-63d3-40c6-b5f5-e4e978ddfe17 => generated 1312 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:28.922928 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-42fa8364-4030-4028-bdf7-2ae388741aa5 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:28.923517 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-42fa8364-4030-4028-bdf7-2ae388741aa5 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] [instance: 1eaf7cc8-63d3-40c6-b5f5-e4e978ddfe17] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:28.929679 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-42fa8364-4030-4028-bdf7-2ae388741aa5 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:28.930162 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-42fa8364-4030-4028-bdf7-2ae388741aa5 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:28.930597 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-42fa8364-4030-4028-bdf7-2ae388741aa5 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:28.931956 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-42fa8364-4030-4028-bdf7-2ae388741aa5 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:28.932412 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-42fa8364-4030-4028-bdf7-2ae388741aa5 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:28.932833 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-42fa8364-4030-4028-bdf7-2ae388741aa5 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:28.945914 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.wsgi [None req-42fa8364-4030-4028-bdf7-2ae388741aa5 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] HTTP exception thrown: Instance 1eaf7cc8-63d3-40c6-b5f5-e4e978ddfe17 could not be found. Oct 28 09:52:28.948080 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-42fa8364-4030-4028-bdf7-2ae388741aa5 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Request method failure captured: Oct 28 09:52:28.948080 dv-cinder-zed-3-smb devstack@n-api.service[127033]: request: GET /compute/v2.1/servers/1eaf7cc8-63d3-40c6-b5f5-e4e978ddfe17 HTTP/1.1 Oct 28 09:52:28.948080 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Accept: application/json Oct 28 09:52:28.948080 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Accept-Encoding: identity Oct 28 09:52:28.948080 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Connection: close Oct 28 09:52:28.948080 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Content-Length: 0 Oct 28 09:52:28.948080 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Content-Type: application/json Oct 28 09:52:28.948080 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Host: 10.222.0.52 Oct 28 09:52:28.948080 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Openstack-System-Scope: None Oct 28 09:52:28.948080 dv-cinder-zed-3-smb devstack@n-api.service[127033]: User-Agent: python-urllib3/1.26.12 Oct 28 09:52:28.948080 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Auth-Token: gAAAAABjW6UMBLZAcB4ofCUEvyoCWt-nTaXzdGXaOtWjwHccK7VrtFAzPPGWsQagqFaH1IBUrfHYI_AtqGoeSDCkxIRD0lzPZ7kumCvA3AUFB0eRrG8vOtKEHyKYUVg_hZG8huan0rPnrbQu2YqOny3faW5JsiVxHZMfNsP73PBj_XjtK1wa1N8 Oct 28 09:52:28.948080 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Domain-Id: None Oct 28 09:52:28.948080 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Domain-Name: None Oct 28 09:52:28.948080 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Identity-Status: Confirmed Oct 28 09:52:28.948080 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Is-Admin-Project: True Oct 28 09:52:28.948080 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Project-Domain-Id: default Oct 28 09:52:28.948080 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Project-Domain-Name: Default Oct 28 09:52:28.948080 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Project-Id: 234f69f21d7a456a9ab6a86c4ac2ede2 Oct 28 09:52:28.948080 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1058371291 Oct 28 09:52:28.948080 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Role: reader,member Oct 28 09:52:28.948080 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Roles: reader,member Oct 28 09:52:28.949583 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_234f69f21d7a456a9ab6a86c4ac2ede2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/234f69f21d7a456a9ab6a86c4ac2ede2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/234f69f21d7a456a9ab6a86c4ac2ede2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/234f69f21d7a456a9ab6a86c4ac2ede2"}]}] Oct 28 09:52:28.949583 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1058371291 Oct 28 09:52:28.949583 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Tenant-Id: 234f69f21d7a456a9ab6a86c4ac2ede2 Oct 28 09:52:28.949583 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1058371291 Oct 28 09:52:28.949583 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User: tempest-ServerRescueNegativeTestJSON-1058371291-project Oct 28 09:52:28.949583 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User-Domain-Id: default Oct 28 09:52:28.949583 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User-Domain-Name: Default Oct 28 09:52:28.949583 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User-Id: cfe6eb38e8df492daaef5755ddea7773 Oct 28 09:52:28.949583 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1058371291-project Oct 28 09:52:28.949583 dv-cinder-zed-3-smb devstack@n-api.service[127033]: method: > Oct 28 09:52:28.949583 dv-cinder-zed-3-smb devstack@n-api.service[127033]: exception: Instance 1eaf7cc8-63d3-40c6-b5f5-e4e978ddfe17 could not be found. Oct 28 09:52:28.949583 dv-cinder-zed-3-smb devstack@n-api.service[127033]: action_args: {'id': '1eaf7cc8-63d3-40c6-b5f5-e4e978ddfe17'} Oct 28 09:52:28.950573 dv-cinder-zed-3-smb devstack@n-api.service[127033]: {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:52:28.950573 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:52:28.950573 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 09:52:28.950573 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 09:52:28.950573 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 09:52:28.950573 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 09:52:28.950573 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 09:52:28.950573 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 09:52:28.950573 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 09:52:28.950573 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 09:52:28.950573 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1eaf7cc8-63d3-40c6-b5f5-e4e978ddfe17 could not be found. Oct 28 09:52:28.950573 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:52:28.950573 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:52:28.950573 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:52:28.950573 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:52:28.950573 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:52:28.950573 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:52:28.950573 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:52:28.950573 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:52:28.950573 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:52:28.952191 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:52:28.952191 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 09:52:28.952191 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 09:52:28.952191 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 09:52:28.952191 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 09:52:28.952191 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 09:52:28.952191 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 09:52:28.952191 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1eaf7cc8-63d3-40c6-b5f5-e4e978ddfe17 could not be found. Oct 28 09:52:28.952191 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:52:28.952191 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:52:28.952191 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:52:28.952191 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:52:28.952191 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:52:28.952191 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:52:28.952191 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:52:28.952191 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:52:28.952191 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1eaf7cc8-63d3-40c6-b5f5-e4e978ddfe17 could not be found. Oct 28 09:52:28.952191 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:52:28.953637 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-42fa8364-4030-4028-bdf7-2ae388741aa5 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] Returning 404 to user: Instance 1eaf7cc8-63d3-40c6-b5f5-e4e978ddfe17 could not be found. {{(pid=127033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:52:28.953637 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-42fa8364-4030-4028-bdf7-2ae388741aa5 tempest-ServerRescueNegativeTestJSON-1058371291 tempest-ServerRescueNegativeTestJSON-1058371291-project] 10.222.0.52 "GET /compute/v2.1/servers/1eaf7cc8-63d3-40c6-b5f5-e4e978ddfe17" status: 404 len: 111 microversion: 2.1 time: 0.031334 Oct 28 09:52:28.953637 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 334/677] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:52:28 2022] GET /compute/v2.1/servers/1eaf7cc8-63d3-40c6-b5f5-e4e978ddfe17 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:52:37.339833 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-977470d6-b2a6-4793-8482-d0db726af186 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Action: 'create', calling method: .version_select at 0x7ff01015a5e0>, body: {"keypair": {"name": "tempest-keypair-1082349739", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBFlRa/ijhRiXmZMk1JBtI6V0R89AMA+wPT16dVxCEREQh+XcOMcDCvEA/vwzHGvvNqNmH70EQRcM4eu8S7FX5+as1/RaQ5881rOyjXcxAUm8YVowh7xP35TR+Ak74k6vw=="}} {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:52:37.356184 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.quota [None req-977470d6-b2a6-4793-8482-d0db726af186 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Getting quotas for project 68e60d7c624e49e1bb43188ae9d7dd2b. Resources: {'key_pairs'} {{(pid=127032) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 09:52:37.360312 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.quota [None req-977470d6-b2a6-4793-8482-d0db726af186 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Getting quotas for user d38ce75423b5412d90c1158396978b97 and project 68e60d7c624e49e1bb43188ae9d7dd2b. Resources: {'key_pairs'} {{(pid=127032) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 09:52:37.383771 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-977470d6-b2a6-4793-8482-d0db726af186 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.173378 Oct 28 09:52:37.384653 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 344/678] 10.222.0.52 () {60 vars in 1159 bytes} [Fri Oct 28 09:52:37 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:52:38.674043 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-988c816c-799a-4490-be4f-357ad9fef489 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-274423130", "imageRef": "6e314146-a2ed-4f8b-afdd-4f7ed1184d20", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a8c5bacf-14eb-40aa-b7c5-10fa69559527"}], "security_groups": [{"name": "tempest-securitygroup--1292383916"}], "key_name": "tempest-keypair-1082349739", "user_data": "}} {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:52:38.786451 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.network.neutron [None req-988c816c-799a-4490-be4f-357ad9fef489 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] validate_networks() for [('a8c5bacf-14eb-40aa-b7c5-10fa69559527', None, None, None, None, None)] {{(pid=127033) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 09:52:38.937456 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG dbcounter [-] [127032] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:52:38.938778 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG dbcounter [-] [127033] Writing DB stats nova_cell1:SELECT=76,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:52:38.942100 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-bd049bb1-b2a6-4cc5-b7e7-86c59bfdbcba tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:38.942600 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-bd049bb1-b2a6-4cc5-b7e7-86c59bfdbcba tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 125194a5-e664-4ea8-ad7e-b0ae1b54e827] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:38.951573 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-bd049bb1-b2a6-4cc5-b7e7-86c59bfdbcba tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:38.952099 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-bd049bb1-b2a6-4cc5-b7e7-86c59bfdbcba tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:38.956410 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-bd049bb1-b2a6-4cc5-b7e7-86c59bfdbcba tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:38.957415 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-bd049bb1-b2a6-4cc5-b7e7-86c59bfdbcba tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:38.958087 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-bd049bb1-b2a6-4cc5-b7e7-86c59bfdbcba tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:38.959088 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-bd049bb1-b2a6-4cc5-b7e7-86c59bfdbcba tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:39.003514 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-bd049bb1-b2a6-4cc5-b7e7-86c59bfdbcba tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827/ips" status: 200 len: 151 microversion: 2.20 time: 0.067317 Oct 28 09:52:39.012597 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 345/679] 10.222.0.52 () {60 vars in 1289 bytes} [Fri Oct 28 09:52:38 2022] GET /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827/ips => generated 151 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 09:52:39.213681 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.virt.hardware [None req-988c816c-799a-4490-be4f-357ad9fef489 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Flavor limits 0:0:0 {{(pid=127033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 09:52:39.214265 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.virt.hardware [None req-988c816c-799a-4490-be4f-357ad9fef489 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Image limits 0:0:0 {{(pid=127033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 09:52:39.214754 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.virt.hardware [None req-988c816c-799a-4490-be4f-357ad9fef489 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Flavor pref 0:0:0 {{(pid=127033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 09:52:39.215381 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.virt.hardware [None req-988c816c-799a-4490-be4f-357ad9fef489 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Image pref 0:0:0 {{(pid=127033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 09:52:39.215876 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.virt.hardware [None req-988c816c-799a-4490-be4f-357ad9fef489 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 09:52:39.218002 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG dbcounter [-] [127033] Writing DB stats nova_api:SELECT=38,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=127033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:52:39.235675 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-988c816c-799a-4490-be4f-357ad9fef489 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:39.236256 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-988c816c-799a-4490-be4f-357ad9fef489 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:39.236853 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-988c816c-799a-4490-be4f-357ad9fef489 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:39.237568 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-988c816c-799a-4490-be4f-357ad9fef489 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:39.238017 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-988c816c-799a-4490-be4f-357ad9fef489 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:39.238434 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-988c816c-799a-4490-be4f-357ad9fef489 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:39.260046 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.quota [None req-988c816c-799a-4490-be4f-357ad9fef489 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Getting quotas for project 68e60d7c624e49e1bb43188ae9d7dd2b. Resources: {'cores', 'ram', 'instances'} {{(pid=127033) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 09:52:39.265427 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.quota [None req-988c816c-799a-4490-be4f-357ad9fef489 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Getting quotas for user d38ce75423b5412d90c1158396978b97 and project 68e60d7c624e49e1bb43188ae9d7dd2b. Resources: {'cores', 'ram', 'instances'} {{(pid=127033) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 09:52:39.283493 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-988c816c-799a-4490-be4f-357ad9fef489 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Going to run 1 instances... {{(pid=127033) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 09:52:39.285980 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-988c816c-799a-4490-be4f-357ad9fef489 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] [instance: 239cbe4b-b0d1-4361-80af-f3015cb39176] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e314146-a2ed-4f8b-afdd-4f7ed1184d20',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127033) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 09:52:39.347457 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-988c816c-799a-4490-be4f-357ad9fef489 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.677313 Oct 28 09:52:39.348449 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 335/680] 10.222.0.52 () {60 vars in 1147 bytes} [Fri Oct 28 09:52:38 2022] POST /compute/v2.1/servers => generated 402 bytes in 679 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 09:52:39.361537 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-85cf96f1-7b6a-4f86-b8c2-f032442aa955 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:39.365101 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-85cf96f1-7b6a-4f86-b8c2-f032442aa955 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] [instance: 239cbe4b-b0d1-4361-80af-f3015cb39176] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:39.433196 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-85cf96f1-7b6a-4f86-b8c2-f032442aa955 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38ce75423b5412d90c1158396978b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e60d7c624e49e1bb43188ae9d7dd2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:39.440552 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-85cf96f1-7b6a-4f86-b8c2-f032442aa955 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] 10.222.0.52 "GET /compute/v2.1/servers/239cbe4b-b0d1-4361-80af-f3015cb39176" status: 200 len: 1241 microversion: 2.1 time: 0.083453 Oct 28 09:52:39.441411 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 346/681] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:52:39 2022] GET /compute/v2.1/servers/239cbe4b-b0d1-4361-80af-f3015cb39176 => generated 1241 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:40.464274 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-90088286-689a-4e41-87c2-19a6629305cd tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:40.464993 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-90088286-689a-4e41-87c2-19a6629305cd tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] [instance: 239cbe4b-b0d1-4361-80af-f3015cb39176] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:40.472774 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-90088286-689a-4e41-87c2-19a6629305cd tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:40.473557 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-90088286-689a-4e41-87c2-19a6629305cd tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:40.474185 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-90088286-689a-4e41-87c2-19a6629305cd tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:40.474956 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-90088286-689a-4e41-87c2-19a6629305cd tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:40.475410 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-90088286-689a-4e41-87c2-19a6629305cd tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:40.475856 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-90088286-689a-4e41-87c2-19a6629305cd tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:40.552242 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-90088286-689a-4e41-87c2-19a6629305cd tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38ce75423b5412d90c1158396978b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e60d7c624e49e1bb43188ae9d7dd2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:40.564637 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-90088286-689a-4e41-87c2-19a6629305cd tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] 10.222.0.52 "GET /compute/v2.1/servers/239cbe4b-b0d1-4361-80af-f3015cb39176" status: 200 len: 1293 microversion: 2.1 time: 0.104122 Oct 28 09:52:40.565238 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 336/682] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:52:40 2022] GET /compute/v2.1/servers/239cbe4b-b0d1-4361-80af-f3015cb39176 => generated 1293 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:41.018335 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-3aae2819-4511-4753-b3b3-4c0693b661f5 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:52:41.019034 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-3aae2819-4511-4753-b3b3-4c0693b661f5 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 125194a5-e664-4ea8-ad7e-b0ae1b54e827] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:41.021419 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG dbcounter [-] [127032] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=127032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:52:41.029916 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-3aae2819-4511-4753-b3b3-4c0693b661f5 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:41.030422 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-3aae2819-4511-4753-b3b3-4c0693b661f5 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:41.030861 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-3aae2819-4511-4753-b3b3-4c0693b661f5 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:41.031584 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-3aae2819-4511-4753-b3b3-4c0693b661f5 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:41.032066 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-3aae2819-4511-4753-b3b3-4c0693b661f5 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:41.032873 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-3aae2819-4511-4753-b3b3-4c0693b661f5 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:41.059997 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.objects.instance [None req-3aae2819-4511-4753-b3b3-4c0693b661f5 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lazy-loading 'flavor' on Instance uuid 125194a5-e664-4ea8-ad7e-b0ae1b54e827 {{(pid=127032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:52:41.272415 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-3aae2819-4511-4753-b3b3-4c0693b661f5 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "POST /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827/action" status: 202 len: 0 microversion: 2.20 time: 0.258013 Oct 28 09:52:41.273016 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 347/683] 10.222.0.52 () {62 vars in 1319 bytes} [Fri Oct 28 09:52:41 2022] POST /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827/action => generated 0 bytes in 260 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 28 09:52:41.281579 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-aac971e4-e58a-4d39-9cb4-6bece69554d9 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:41.282198 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-aac971e4-e58a-4d39-9cb4-6bece69554d9 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 125194a5-e664-4ea8-ad7e-b0ae1b54e827] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:41.289197 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-aac971e4-e58a-4d39-9cb4-6bece69554d9 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:41.289699 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-aac971e4-e58a-4d39-9cb4-6bece69554d9 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:41.290190 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-aac971e4-e58a-4d39-9cb4-6bece69554d9 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:41.290884 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-aac971e4-e58a-4d39-9cb4-6bece69554d9 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:41.291347 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-aac971e4-e58a-4d39-9cb4-6bece69554d9 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:41.291865 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-aac971e4-e58a-4d39-9cb4-6bece69554d9 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:41.425567 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-aac971e4-e58a-4d39-9cb4-6bece69554d9 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:41.434589 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-aac971e4-e58a-4d39-9cb4-6bece69554d9 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:41.436174 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-aac971e4-e58a-4d39-9cb4-6bece69554d9 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:41.437353 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-aac971e4-e58a-4d39-9cb4-6bece69554d9 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827" status: 200 len: 1721 microversion: 2.20 time: 0.159890 Oct 28 09:52:41.437936 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 337/684] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:52:41 2022] GET /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827 => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:52:41.589997 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-8edd5df5-4043-4e7a-ba77-0613cc1798ed tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:41.591026 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-8edd5df5-4043-4e7a-ba77-0613cc1798ed tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] [instance: 239cbe4b-b0d1-4361-80af-f3015cb39176] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:41.597837 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-8edd5df5-4043-4e7a-ba77-0613cc1798ed tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:41.598325 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-8edd5df5-4043-4e7a-ba77-0613cc1798ed tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:41.598756 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-8edd5df5-4043-4e7a-ba77-0613cc1798ed tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:41.599456 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-8edd5df5-4043-4e7a-ba77-0613cc1798ed tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:41.599976 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-8edd5df5-4043-4e7a-ba77-0613cc1798ed tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:41.600556 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-8edd5df5-4043-4e7a-ba77-0613cc1798ed tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:41.749629 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-8edd5df5-4043-4e7a-ba77-0613cc1798ed tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38ce75423b5412d90c1158396978b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e60d7c624e49e1bb43188ae9d7dd2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:41.757488 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-8edd5df5-4043-4e7a-ba77-0613cc1798ed tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] 10.222.0.52 "GET /compute/v2.1/servers/239cbe4b-b0d1-4361-80af-f3015cb39176" status: 200 len: 1367 microversion: 2.1 time: 0.172408 Oct 28 09:52:41.758056 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 348/685] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:52:41 2022] GET /compute/v2.1/servers/239cbe4b-b0d1-4361-80af-f3015cb39176 => generated 1367 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:42.436988 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [req-f321cb4d-27a6-4bcf-8376-b452f954a055 req-51dff020-a54b-466c-a1d3-de2c123709fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "239cbe4b-b0d1-4361-80af-f3015cb39176", "tag": "b789fb10-4c3e-4628-b3fd-048e4ddace53"}]} {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:52:42.449162 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-f321cb4d-27a6-4bcf-8376-b452f954a055 req-51dff020-a54b-466c-a1d3-de2c123709fc service nova] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:42.450014 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-f321cb4d-27a6-4bcf-8376-b452f954a055 req-51dff020-a54b-466c-a1d3-de2c123709fc service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:42.450458 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-f321cb4d-27a6-4bcf-8376-b452f954a055 req-51dff020-a54b-466c-a1d3-de2c123709fc service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:42.461812 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.compute.server_external_events [req-f321cb4d-27a6-4bcf-8376-b452f954a055 req-51dff020-a54b-466c-a1d3-de2c123709fc service nova] Creating event network-changed:b789fb10-4c3e-4628-b3fd-048e4ddace53 for instance 239cbe4b-b0d1-4361-80af-f3015cb39176 on hv-cinder-zed-3 Oct 28 09:52:42.465092 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-116f7f20-17a4-4629-995b-79087326c423 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:42.465846 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-116f7f20-17a4-4629-995b-79087326c423 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 125194a5-e664-4ea8-ad7e-b0ae1b54e827] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:42.468485 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [req-f321cb4d-27a6-4bcf-8376-b452f954a055 req-51dff020-a54b-466c-a1d3-de2c123709fc service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035923 Oct 28 09:52:42.469812 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 338/686] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Oct 28 09:52:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:52:42.472419 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-116f7f20-17a4-4629-995b-79087326c423 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:42.472902 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-116f7f20-17a4-4629-995b-79087326c423 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:42.473326 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-116f7f20-17a4-4629-995b-79087326c423 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:42.474268 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-116f7f20-17a4-4629-995b-79087326c423 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:42.476254 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-116f7f20-17a4-4629-995b-79087326c423 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:42.476848 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-116f7f20-17a4-4629-995b-79087326c423 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:42.607245 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-116f7f20-17a4-4629-995b-79087326c423 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:42.615638 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-116f7f20-17a4-4629-995b-79087326c423 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:42.617140 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-116f7f20-17a4-4629-995b-79087326c423 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:42.619017 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-116f7f20-17a4-4629-995b-79087326c423 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827" status: 200 len: 1721 microversion: 2.20 time: 0.158160 Oct 28 09:52:42.619584 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 349/687] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:52:42 2022] GET /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827 => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:52:42.781914 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-8e722074-ddb4-4a70-b2ce-82936c7310d9 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:42.783242 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-8e722074-ddb4-4a70-b2ce-82936c7310d9 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] [instance: 239cbe4b-b0d1-4361-80af-f3015cb39176] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:42.789865 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-8e722074-ddb4-4a70-b2ce-82936c7310d9 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:42.790270 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-8e722074-ddb4-4a70-b2ce-82936c7310d9 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:42.790628 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-8e722074-ddb4-4a70-b2ce-82936c7310d9 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:42.791351 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-8e722074-ddb4-4a70-b2ce-82936c7310d9 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:42.791841 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-8e722074-ddb4-4a70-b2ce-82936c7310d9 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:42.792248 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-8e722074-ddb4-4a70-b2ce-82936c7310d9 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:42.933074 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-8e722074-ddb4-4a70-b2ce-82936c7310d9 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38ce75423b5412d90c1158396978b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e60d7c624e49e1bb43188ae9d7dd2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:42.940882 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-8e722074-ddb4-4a70-b2ce-82936c7310d9 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] 10.222.0.52 "GET /compute/v2.1/servers/239cbe4b-b0d1-4361-80af-f3015cb39176" status: 200 len: 1367 microversion: 2.1 time: 0.163261 Oct 28 09:52:42.941362 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 339/688] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:52:42 2022] GET /compute/v2.1/servers/239cbe4b-b0d1-4361-80af-f3015cb39176 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:43.645589 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-a152ac36-8147-405a-9e4e-c05f15ba59d2 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:43.646107 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-a152ac36-8147-405a-9e4e-c05f15ba59d2 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 125194a5-e664-4ea8-ad7e-b0ae1b54e827] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:43.652821 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-a152ac36-8147-405a-9e4e-c05f15ba59d2 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:43.653292 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-a152ac36-8147-405a-9e4e-c05f15ba59d2 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:43.653716 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-a152ac36-8147-405a-9e4e-c05f15ba59d2 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:43.654397 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-a152ac36-8147-405a-9e4e-c05f15ba59d2 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:43.654840 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-a152ac36-8147-405a-9e4e-c05f15ba59d2 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:43.655253 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-a152ac36-8147-405a-9e4e-c05f15ba59d2 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:43.786690 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-a152ac36-8147-405a-9e4e-c05f15ba59d2 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:43.795491 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-a152ac36-8147-405a-9e4e-c05f15ba59d2 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:43.796966 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-a152ac36-8147-405a-9e4e-c05f15ba59d2 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:43.798137 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-a152ac36-8147-405a-9e4e-c05f15ba59d2 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827" status: 200 len: 1721 microversion: 2.20 time: 0.156600 Oct 28 09:52:43.798694 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 350/689] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:52:43 2022] GET /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827 => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:52:43.964336 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-0f4842a9-43de-489d-bb3a-f6a27e7ffb6e tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:43.964924 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-0f4842a9-43de-489d-bb3a-f6a27e7ffb6e tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] [instance: 239cbe4b-b0d1-4361-80af-f3015cb39176] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:43.971316 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-0f4842a9-43de-489d-bb3a-f6a27e7ffb6e tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:43.971829 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-0f4842a9-43de-489d-bb3a-f6a27e7ffb6e tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:43.972267 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-0f4842a9-43de-489d-bb3a-f6a27e7ffb6e tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:43.972953 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-0f4842a9-43de-489d-bb3a-f6a27e7ffb6e tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:43.973410 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-0f4842a9-43de-489d-bb3a-f6a27e7ffb6e tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:43.973836 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-0f4842a9-43de-489d-bb3a-f6a27e7ffb6e tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:44.103978 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-0f4842a9-43de-489d-bb3a-f6a27e7ffb6e tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38ce75423b5412d90c1158396978b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e60d7c624e49e1bb43188ae9d7dd2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:44.111598 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-0f4842a9-43de-489d-bb3a-f6a27e7ffb6e tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] 10.222.0.52 "GET /compute/v2.1/servers/239cbe4b-b0d1-4361-80af-f3015cb39176" status: 200 len: 1367 microversion: 2.1 time: 0.151185 Oct 28 09:52:44.112201 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 340/690] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:52:43 2022] GET /compute/v2.1/servers/239cbe4b-b0d1-4361-80af-f3015cb39176 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:44.823862 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-d36eb1d4-804a-4720-87fc-607dc16fd7e2 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:44.824468 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-d36eb1d4-804a-4720-87fc-607dc16fd7e2 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 125194a5-e664-4ea8-ad7e-b0ae1b54e827] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:44.830962 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-d36eb1d4-804a-4720-87fc-607dc16fd7e2 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:44.831449 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-d36eb1d4-804a-4720-87fc-607dc16fd7e2 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:44.831930 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-d36eb1d4-804a-4720-87fc-607dc16fd7e2 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:44.832625 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-d36eb1d4-804a-4720-87fc-607dc16fd7e2 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:44.833085 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-d36eb1d4-804a-4720-87fc-607dc16fd7e2 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:44.833524 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-d36eb1d4-804a-4720-87fc-607dc16fd7e2 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:44.966199 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-d36eb1d4-804a-4720-87fc-607dc16fd7e2 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:44.974421 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-d36eb1d4-804a-4720-87fc-607dc16fd7e2 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:44.975888 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-d36eb1d4-804a-4720-87fc-607dc16fd7e2 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:44.977057 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-d36eb1d4-804a-4720-87fc-607dc16fd7e2 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827" status: 200 len: 1721 microversion: 2.20 time: 0.157850 Oct 28 09:52:44.977677 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 351/691] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:52:44 2022] GET /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827 => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:52:45.135694 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-1b115734-25c4-4de5-86e1-f374d947c973 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:45.136410 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-1b115734-25c4-4de5-86e1-f374d947c973 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] [instance: 239cbe4b-b0d1-4361-80af-f3015cb39176] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:45.142737 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-1b115734-25c4-4de5-86e1-f374d947c973 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:45.143223 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-1b115734-25c4-4de5-86e1-f374d947c973 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:45.143652 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-1b115734-25c4-4de5-86e1-f374d947c973 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:45.144485 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-1b115734-25c4-4de5-86e1-f374d947c973 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:45.144945 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-1b115734-25c4-4de5-86e1-f374d947c973 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:45.145364 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-1b115734-25c4-4de5-86e1-f374d947c973 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:45.278131 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-1b115734-25c4-4de5-86e1-f374d947c973 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38ce75423b5412d90c1158396978b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e60d7c624e49e1bb43188ae9d7dd2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:45.286357 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-1b115734-25c4-4de5-86e1-f374d947c973 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] 10.222.0.52 "GET /compute/v2.1/servers/239cbe4b-b0d1-4361-80af-f3015cb39176" status: 200 len: 1367 microversion: 2.1 time: 0.155203 Oct 28 09:52:45.286933 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 341/692] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:52:45 2022] GET /compute/v2.1/servers/239cbe4b-b0d1-4361-80af-f3015cb39176 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:46.002503 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-d637d7b2-aea8-4fec-8914-eb02b85e08a9 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:46.003125 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-d637d7b2-aea8-4fec-8914-eb02b85e08a9 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 125194a5-e664-4ea8-ad7e-b0ae1b54e827] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:46.010207 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-d637d7b2-aea8-4fec-8914-eb02b85e08a9 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:46.010695 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-d637d7b2-aea8-4fec-8914-eb02b85e08a9 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:46.011129 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-d637d7b2-aea8-4fec-8914-eb02b85e08a9 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:46.011873 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-d637d7b2-aea8-4fec-8914-eb02b85e08a9 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:46.012334 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-d637d7b2-aea8-4fec-8914-eb02b85e08a9 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:46.012759 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-d637d7b2-aea8-4fec-8914-eb02b85e08a9 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:46.149543 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-d637d7b2-aea8-4fec-8914-eb02b85e08a9 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:46.158526 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-d637d7b2-aea8-4fec-8914-eb02b85e08a9 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:46.160615 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-d637d7b2-aea8-4fec-8914-eb02b85e08a9 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:46.162347 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-d637d7b2-aea8-4fec-8914-eb02b85e08a9 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827" status: 200 len: 1721 microversion: 2.20 time: 0.163794 Oct 28 09:52:46.163540 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 352/693] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:52:45 2022] GET /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827 => generated 1721 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:52:46.309340 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-c6a412d1-8bf5-4112-acb0-a78804641702 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:46.309954 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-c6a412d1-8bf5-4112-acb0-a78804641702 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] [instance: 239cbe4b-b0d1-4361-80af-f3015cb39176] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:46.316525 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-c6a412d1-8bf5-4112-acb0-a78804641702 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:46.317003 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-c6a412d1-8bf5-4112-acb0-a78804641702 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:46.317431 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-c6a412d1-8bf5-4112-acb0-a78804641702 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:46.318142 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-c6a412d1-8bf5-4112-acb0-a78804641702 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:46.318762 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-c6a412d1-8bf5-4112-acb0-a78804641702 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:46.319180 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-c6a412d1-8bf5-4112-acb0-a78804641702 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:46.448476 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-c6a412d1-8bf5-4112-acb0-a78804641702 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38ce75423b5412d90c1158396978b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e60d7c624e49e1bb43188ae9d7dd2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:46.456262 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-c6a412d1-8bf5-4112-acb0-a78804641702 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] 10.222.0.52 "GET /compute/v2.1/servers/239cbe4b-b0d1-4361-80af-f3015cb39176" status: 200 len: 1367 microversion: 2.1 time: 0.150774 Oct 28 09:52:46.456848 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 342/694] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:52:46 2022] GET /compute/v2.1/servers/239cbe4b-b0d1-4361-80af-f3015cb39176 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:47.188013 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-3dec8641-addd-4a69-9197-72216f68d4e7 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:47.188622 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-3dec8641-addd-4a69-9197-72216f68d4e7 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 125194a5-e664-4ea8-ad7e-b0ae1b54e827] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:47.195004 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-3dec8641-addd-4a69-9197-72216f68d4e7 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:47.195491 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-3dec8641-addd-4a69-9197-72216f68d4e7 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:47.195964 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-3dec8641-addd-4a69-9197-72216f68d4e7 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:47.196718 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-3dec8641-addd-4a69-9197-72216f68d4e7 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:47.197175 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-3dec8641-addd-4a69-9197-72216f68d4e7 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:47.197598 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-3dec8641-addd-4a69-9197-72216f68d4e7 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:47.324481 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-3dec8641-addd-4a69-9197-72216f68d4e7 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:47.333403 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-3dec8641-addd-4a69-9197-72216f68d4e7 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:47.334887 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-3dec8641-addd-4a69-9197-72216f68d4e7 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:47.336099 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-3dec8641-addd-4a69-9197-72216f68d4e7 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827" status: 200 len: 1721 microversion: 2.20 time: 0.152052 Oct 28 09:52:47.336663 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 353/695] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:52:47 2022] GET /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827 => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:52:47.479612 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-76a25adb-e063-4554-94b5-058178dae443 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:47.480246 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-76a25adb-e063-4554-94b5-058178dae443 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] [instance: 239cbe4b-b0d1-4361-80af-f3015cb39176] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:47.486571 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-76a25adb-e063-4554-94b5-058178dae443 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:47.487049 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-76a25adb-e063-4554-94b5-058178dae443 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:47.487480 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-76a25adb-e063-4554-94b5-058178dae443 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:47.488195 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-76a25adb-e063-4554-94b5-058178dae443 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:47.488647 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-76a25adb-e063-4554-94b5-058178dae443 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:47.489332 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-76a25adb-e063-4554-94b5-058178dae443 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:47.620452 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-76a25adb-e063-4554-94b5-058178dae443 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38ce75423b5412d90c1158396978b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e60d7c624e49e1bb43188ae9d7dd2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:47.628095 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-76a25adb-e063-4554-94b5-058178dae443 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] 10.222.0.52 "GET /compute/v2.1/servers/239cbe4b-b0d1-4361-80af-f3015cb39176" status: 200 len: 1367 microversion: 2.1 time: 0.152373 Oct 28 09:52:47.628671 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 343/696] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:52:47 2022] GET /compute/v2.1/servers/239cbe4b-b0d1-4361-80af-f3015cb39176 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:48.343367 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [req-0837e094-e352-4095-adcd-4962081777ce req-bfd3e35e-521e-4b7f-a739-757214c96f71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "239cbe4b-b0d1-4361-80af-f3015cb39176", "name": "network-vif-plugged", "status": "completed", "tag": "b789fb10-4c3e-4628-b3fd-048e4ddace53"}]} {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:52:48.353559 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-0837e094-e352-4095-adcd-4962081777ce req-bfd3e35e-521e-4b7f-a739-757214c96f71 service nova] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:48.354044 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-0837e094-e352-4095-adcd-4962081777ce req-bfd3e35e-521e-4b7f-a739-757214c96f71 service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:48.354461 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-0837e094-e352-4095-adcd-4962081777ce req-bfd3e35e-521e-4b7f-a739-757214c96f71 service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:48.362610 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-b828c307-ae0c-4d0c-a5eb-60d633764c95 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:48.363219 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-b828c307-ae0c-4d0c-a5eb-60d633764c95 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 125194a5-e664-4ea8-ad7e-b0ae1b54e827] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:48.366200 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.compute.server_external_events [req-0837e094-e352-4095-adcd-4962081777ce req-bfd3e35e-521e-4b7f-a739-757214c96f71 service nova] Creating event network-vif-plugged:b789fb10-4c3e-4628-b3fd-048e4ddace53 for instance 239cbe4b-b0d1-4361-80af-f3015cb39176 on hv-cinder-zed-3 Oct 28 09:52:48.370568 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-b828c307-ae0c-4d0c-a5eb-60d633764c95 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:48.371063 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-b828c307-ae0c-4d0c-a5eb-60d633764c95 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:48.371346 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [req-0837e094-e352-4095-adcd-4962081777ce req-bfd3e35e-521e-4b7f-a739-757214c96f71 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031665 Oct 28 09:52:48.371536 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-b828c307-ae0c-4d0c-a5eb-60d633764c95 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:48.372264 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 354/697] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Oct 28 09:52:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:52:48.372398 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-b828c307-ae0c-4d0c-a5eb-60d633764c95 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:48.372696 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-b828c307-ae0c-4d0c-a5eb-60d633764c95 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:48.373116 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-b828c307-ae0c-4d0c-a5eb-60d633764c95 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:48.514524 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-b828c307-ae0c-4d0c-a5eb-60d633764c95 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:48.524113 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-b828c307-ae0c-4d0c-a5eb-60d633764c95 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:48.526248 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-b828c307-ae0c-4d0c-a5eb-60d633764c95 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:48.527419 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-b828c307-ae0c-4d0c-a5eb-60d633764c95 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827" status: 200 len: 1721 microversion: 2.20 time: 0.168663 Oct 28 09:52:48.528020 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 344/698] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:52:48 2022] GET /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827 => generated 1721 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:52:48.651711 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-c8031741-359d-46fa-b768-420eaa6e89fc tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:48.652386 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-c8031741-359d-46fa-b768-420eaa6e89fc tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] [instance: 239cbe4b-b0d1-4361-80af-f3015cb39176] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:48.658494 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-c8031741-359d-46fa-b768-420eaa6e89fc tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:48.658975 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-c8031741-359d-46fa-b768-420eaa6e89fc tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:48.659412 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-c8031741-359d-46fa-b768-420eaa6e89fc tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:48.660190 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-c8031741-359d-46fa-b768-420eaa6e89fc tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:48.660584 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-c8031741-359d-46fa-b768-420eaa6e89fc tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:48.661005 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-c8031741-359d-46fa-b768-420eaa6e89fc tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:48.791688 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-c8031741-359d-46fa-b768-420eaa6e89fc tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38ce75423b5412d90c1158396978b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e60d7c624e49e1bb43188ae9d7dd2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:48.799307 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-c8031741-359d-46fa-b768-420eaa6e89fc tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] 10.222.0.52 "GET /compute/v2.1/servers/239cbe4b-b0d1-4361-80af-f3015cb39176" status: 200 len: 1367 microversion: 2.1 time: 0.151848 Oct 28 09:52:48.799895 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 355/699] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:52:48 2022] GET /compute/v2.1/servers/239cbe4b-b0d1-4361-80af-f3015cb39176 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:49.553021 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-ed941d5e-d142-4b48-920a-5a4e09b4d1a4 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:49.553628 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-ed941d5e-d142-4b48-920a-5a4e09b4d1a4 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 125194a5-e664-4ea8-ad7e-b0ae1b54e827] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:49.555553 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG dbcounter [-] [127033] Writing DB stats nova_cell0:SELECT=2 {{(pid=127033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:52:49.556794 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG dbcounter [-] [127033] Writing DB stats nova_cell0:SELECT=6 {{(pid=127033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:52:49.562457 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-ed941d5e-d142-4b48-920a-5a4e09b4d1a4 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:49.562936 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-ed941d5e-d142-4b48-920a-5a4e09b4d1a4 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:49.563364 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-ed941d5e-d142-4b48-920a-5a4e09b4d1a4 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:49.564087 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-ed941d5e-d142-4b48-920a-5a4e09b4d1a4 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:49.564574 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-ed941d5e-d142-4b48-920a-5a4e09b4d1a4 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:49.564989 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-ed941d5e-d142-4b48-920a-5a4e09b4d1a4 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:49.690801 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-ed941d5e-d142-4b48-920a-5a4e09b4d1a4 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:49.699529 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-ed941d5e-d142-4b48-920a-5a4e09b4d1a4 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:49.701052 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-ed941d5e-d142-4b48-920a-5a4e09b4d1a4 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:49.702220 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-ed941d5e-d142-4b48-920a-5a4e09b4d1a4 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827" status: 200 len: 1721 microversion: 2.20 time: 0.153324 Oct 28 09:52:49.702788 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 345/700] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:52:49 2022] GET /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827 => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:52:49.822620 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-623bbac9-397b-4fea-adda-e35f2650b44e tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:49.823224 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-623bbac9-397b-4fea-adda-e35f2650b44e tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] [instance: 239cbe4b-b0d1-4361-80af-f3015cb39176] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:49.825983 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG dbcounter [-] [127032] Writing DB stats nova_cell0:SELECT=6 {{(pid=127032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:52:49.831348 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-623bbac9-397b-4fea-adda-e35f2650b44e tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:49.831869 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-623bbac9-397b-4fea-adda-e35f2650b44e tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:49.832304 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-623bbac9-397b-4fea-adda-e35f2650b44e tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:49.832996 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-623bbac9-397b-4fea-adda-e35f2650b44e tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:49.833448 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-623bbac9-397b-4fea-adda-e35f2650b44e tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:49.833866 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-623bbac9-397b-4fea-adda-e35f2650b44e tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:49.963135 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-623bbac9-397b-4fea-adda-e35f2650b44e tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38ce75423b5412d90c1158396978b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e60d7c624e49e1bb43188ae9d7dd2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:49.970745 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-623bbac9-397b-4fea-adda-e35f2650b44e tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] 10.222.0.52 "GET /compute/v2.1/servers/239cbe4b-b0d1-4361-80af-f3015cb39176" status: 200 len: 1367 microversion: 2.1 time: 0.152006 Oct 28 09:52:49.971321 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 356/701] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:52:49 2022] GET /compute/v2.1/servers/239cbe4b-b0d1-4361-80af-f3015cb39176 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:50.727980 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-7d7103cb-45d5-4929-85c9-71f680bf9db5 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:50.728617 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-7d7103cb-45d5-4929-85c9-71f680bf9db5 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 125194a5-e664-4ea8-ad7e-b0ae1b54e827] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:50.735333 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-7d7103cb-45d5-4929-85c9-71f680bf9db5 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:50.735522 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-7d7103cb-45d5-4929-85c9-71f680bf9db5 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:50.736001 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-7d7103cb-45d5-4929-85c9-71f680bf9db5 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:50.736700 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-7d7103cb-45d5-4929-85c9-71f680bf9db5 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:50.737159 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-7d7103cb-45d5-4929-85c9-71f680bf9db5 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:50.737584 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-7d7103cb-45d5-4929-85c9-71f680bf9db5 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:50.868678 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-7d7103cb-45d5-4929-85c9-71f680bf9db5 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:50.877332 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-7d7103cb-45d5-4929-85c9-71f680bf9db5 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:50.878792 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-7d7103cb-45d5-4929-85c9-71f680bf9db5 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:50.879991 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-7d7103cb-45d5-4929-85c9-71f680bf9db5 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827" status: 200 len: 1721 microversion: 2.20 time: 0.155993 Oct 28 09:52:50.880558 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 346/702] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:52:50 2022] GET /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:52:50.995009 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-29ea6a7b-214e-4787-8e81-9fb964485c5b tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:50.995563 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-29ea6a7b-214e-4787-8e81-9fb964485c5b tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] [instance: 239cbe4b-b0d1-4361-80af-f3015cb39176] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:51.001812 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-29ea6a7b-214e-4787-8e81-9fb964485c5b tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:51.002287 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-29ea6a7b-214e-4787-8e81-9fb964485c5b tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:51.002719 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-29ea6a7b-214e-4787-8e81-9fb964485c5b tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:51.003398 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-29ea6a7b-214e-4787-8e81-9fb964485c5b tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:51.003875 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-29ea6a7b-214e-4787-8e81-9fb964485c5b tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:51.004290 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-29ea6a7b-214e-4787-8e81-9fb964485c5b tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:51.135864 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-29ea6a7b-214e-4787-8e81-9fb964485c5b tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38ce75423b5412d90c1158396978b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e60d7c624e49e1bb43188ae9d7dd2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:51.143800 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-29ea6a7b-214e-4787-8e81-9fb964485c5b tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] 10.222.0.52 "GET /compute/v2.1/servers/239cbe4b-b0d1-4361-80af-f3015cb39176" status: 200 len: 1557 microversion: 2.1 time: 0.153219 Oct 28 09:52:51.144373 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 357/703] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:52:50 2022] GET /compute/v2.1/servers/239cbe4b-b0d1-4361-80af-f3015cb39176 => generated 1557 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:51.167314 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-f4c3c916-c99f-4d8e-95de-e6debc40c9f7 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:51.167826 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-f4c3c916-c99f-4d8e-95de-e6debc40c9f7 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] [instance: 239cbe4b-b0d1-4361-80af-f3015cb39176] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:51.173650 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-f4c3c916-c99f-4d8e-95de-e6debc40c9f7 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:51.174129 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-f4c3c916-c99f-4d8e-95de-e6debc40c9f7 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:51.174561 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-f4c3c916-c99f-4d8e-95de-e6debc40c9f7 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:51.175241 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-f4c3c916-c99f-4d8e-95de-e6debc40c9f7 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:51.175695 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-f4c3c916-c99f-4d8e-95de-e6debc40c9f7 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:51.176152 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-f4c3c916-c99f-4d8e-95de-e6debc40c9f7 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:51.254182 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-f4c3c916-c99f-4d8e-95de-e6debc40c9f7 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] 10.222.0.52 "GET /compute/v2.1/servers/239cbe4b-b0d1-4361-80af-f3015cb39176/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091230 Oct 28 09:52:51.254778 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 347/704] 10.222.0.52 () {58 vars in 1275 bytes} [Fri Oct 28 09:52:51 2022] GET /compute/v2.1/servers/239cbe4b-b0d1-4361-80af-f3015cb39176/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:52:51.905786 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-61a71a1c-57d0-43ab-8956-401703dfd160 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:51.906397 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-61a71a1c-57d0-43ab-8956-401703dfd160 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 125194a5-e664-4ea8-ad7e-b0ae1b54e827] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:51.912372 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-61a71a1c-57d0-43ab-8956-401703dfd160 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:51.912940 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-61a71a1c-57d0-43ab-8956-401703dfd160 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:51.913355 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-61a71a1c-57d0-43ab-8956-401703dfd160 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:51.913998 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-61a71a1c-57d0-43ab-8956-401703dfd160 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:51.914454 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-61a71a1c-57d0-43ab-8956-401703dfd160 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:51.914878 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-61a71a1c-57d0-43ab-8956-401703dfd160 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:52.296049 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-61a71a1c-57d0-43ab-8956-401703dfd160 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:52.305027 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-61a71a1c-57d0-43ab-8956-401703dfd160 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:52.306499 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-61a71a1c-57d0-43ab-8956-401703dfd160 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:52.307834 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-61a71a1c-57d0-43ab-8956-401703dfd160 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827" status: 200 len: 1721 microversion: 2.20 time: 0.405935 Oct 28 09:52:52.308322 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 358/705] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:52:51 2022] GET /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827 => generated 1721 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:52:52.543113 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [req-87ca7d7e-ed83-41e5-9d33-895c800b56c9 req-0e809fc9-6969-4df1-86ec-8c95418eac52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "239cbe4b-b0d1-4361-80af-f3015cb39176", "tag": "b789fb10-4c3e-4628-b3fd-048e4ddace53"}]} {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:52:52.560423 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-87ca7d7e-ed83-41e5-9d33-895c800b56c9 req-0e809fc9-6969-4df1-86ec-8c95418eac52 service nova] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:52.561285 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-87ca7d7e-ed83-41e5-9d33-895c800b56c9 req-0e809fc9-6969-4df1-86ec-8c95418eac52 service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:52.562067 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-87ca7d7e-ed83-41e5-9d33-895c800b56c9 req-0e809fc9-6969-4df1-86ec-8c95418eac52 service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:52.576585 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.compute.server_external_events [req-87ca7d7e-ed83-41e5-9d33-895c800b56c9 req-0e809fc9-6969-4df1-86ec-8c95418eac52 service nova] Creating event network-changed:b789fb10-4c3e-4628-b3fd-048e4ddace53 for instance 239cbe4b-b0d1-4361-80af-f3015cb39176 on hv-cinder-zed-3 Oct 28 09:52:52.583055 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [req-87ca7d7e-ed83-41e5-9d33-895c800b56c9 req-0e809fc9-6969-4df1-86ec-8c95418eac52 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.142716 Oct 28 09:52:52.584059 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 348/706] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Oct 28 09:52:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:52:53.332839 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-3d434515-a3aa-4f04-8ca6-b19ba540b8bb tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:53.333412 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-3d434515-a3aa-4f04-8ca6-b19ba540b8bb tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 125194a5-e664-4ea8-ad7e-b0ae1b54e827] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:53.341031 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-3d434515-a3aa-4f04-8ca6-b19ba540b8bb tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:53.341534 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-3d434515-a3aa-4f04-8ca6-b19ba540b8bb tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:53.341970 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-3d434515-a3aa-4f04-8ca6-b19ba540b8bb tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:53.342898 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-3d434515-a3aa-4f04-8ca6-b19ba540b8bb tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:53.343424 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-3d434515-a3aa-4f04-8ca6-b19ba540b8bb tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:53.343895 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-3d434515-a3aa-4f04-8ca6-b19ba540b8bb tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:53.476933 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-3d434515-a3aa-4f04-8ca6-b19ba540b8bb tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:53.485695 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-3d434515-a3aa-4f04-8ca6-b19ba540b8bb tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:53.487155 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-3d434515-a3aa-4f04-8ca6-b19ba540b8bb tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:53.488358 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-3d434515-a3aa-4f04-8ca6-b19ba540b8bb tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827" status: 200 len: 1721 microversion: 2.20 time: 0.159641 Oct 28 09:52:53.499272 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 359/707] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:52:53 2022] GET /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827 => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:52:54.515596 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-5d070960-621a-4d77-9430-926179670fb1 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:54.516322 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-5d070960-621a-4d77-9430-926179670fb1 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 125194a5-e664-4ea8-ad7e-b0ae1b54e827] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:54.522460 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-5d070960-621a-4d77-9430-926179670fb1 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:54.522942 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-5d070960-621a-4d77-9430-926179670fb1 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:54.523378 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-5d070960-621a-4d77-9430-926179670fb1 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:54.524111 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-5d070960-621a-4d77-9430-926179670fb1 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:54.524574 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-5d070960-621a-4d77-9430-926179670fb1 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:54.524989 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-5d070960-621a-4d77-9430-926179670fb1 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:54.657580 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-5d070960-621a-4d77-9430-926179670fb1 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:54.665767 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-5d070960-621a-4d77-9430-926179670fb1 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:54.667455 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-5d070960-621a-4d77-9430-926179670fb1 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:54.668798 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-5d070960-621a-4d77-9430-926179670fb1 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827" status: 200 len: 1721 microversion: 2.20 time: 0.158565 Oct 28 09:52:54.669371 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 349/708] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:52:54 2022] GET /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827 => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:52:55.693991 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-ebccd41c-cbe7-4b67-8574-daf66c996330 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:55.694597 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-ebccd41c-cbe7-4b67-8574-daf66c996330 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 125194a5-e664-4ea8-ad7e-b0ae1b54e827] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:55.701092 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ebccd41c-cbe7-4b67-8574-daf66c996330 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:55.701575 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ebccd41c-cbe7-4b67-8574-daf66c996330 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:55.702008 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ebccd41c-cbe7-4b67-8574-daf66c996330 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:55.702706 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ebccd41c-cbe7-4b67-8574-daf66c996330 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:55.703161 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ebccd41c-cbe7-4b67-8574-daf66c996330 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:55.703591 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ebccd41c-cbe7-4b67-8574-daf66c996330 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:55.829480 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-ebccd41c-cbe7-4b67-8574-daf66c996330 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:55.837585 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-ebccd41c-cbe7-4b67-8574-daf66c996330 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:55.839085 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-ebccd41c-cbe7-4b67-8574-daf66c996330 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:55.840282 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-ebccd41c-cbe7-4b67-8574-daf66c996330 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827" status: 200 len: 1721 microversion: 2.20 time: 0.150213 Oct 28 09:52:55.840839 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 360/709] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:52:55 2022] GET /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827 => generated 1721 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:52:56.866236 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-00f64894-fc7c-40cc-8c3e-3040c0ab28d8 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:56.866884 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-00f64894-fc7c-40cc-8c3e-3040c0ab28d8 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 125194a5-e664-4ea8-ad7e-b0ae1b54e827] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:56.873934 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-00f64894-fc7c-40cc-8c3e-3040c0ab28d8 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:56.874421 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-00f64894-fc7c-40cc-8c3e-3040c0ab28d8 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:56.874859 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-00f64894-fc7c-40cc-8c3e-3040c0ab28d8 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:56.875544 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-00f64894-fc7c-40cc-8c3e-3040c0ab28d8 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:56.876043 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-00f64894-fc7c-40cc-8c3e-3040c0ab28d8 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:56.876464 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-00f64894-fc7c-40cc-8c3e-3040c0ab28d8 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:57.002218 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-00f64894-fc7c-40cc-8c3e-3040c0ab28d8 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:57.011079 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-00f64894-fc7c-40cc-8c3e-3040c0ab28d8 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:57.012562 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-00f64894-fc7c-40cc-8c3e-3040c0ab28d8 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:57.013730 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-00f64894-fc7c-40cc-8c3e-3040c0ab28d8 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827" status: 200 len: 1721 microversion: 2.20 time: 0.151737 Oct 28 09:52:57.014287 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 350/710] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:52:56 2022] GET /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827 => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:52:58.038921 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-95af8c58-6277-4db4-b37f-c502429d9a01 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:58.039511 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-95af8c58-6277-4db4-b37f-c502429d9a01 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 125194a5-e664-4ea8-ad7e-b0ae1b54e827] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:58.045935 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-95af8c58-6277-4db4-b37f-c502429d9a01 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:58.046415 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-95af8c58-6277-4db4-b37f-c502429d9a01 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:58.046847 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-95af8c58-6277-4db4-b37f-c502429d9a01 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:58.047535 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-95af8c58-6277-4db4-b37f-c502429d9a01 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:58.048012 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-95af8c58-6277-4db4-b37f-c502429d9a01 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:58.048433 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-95af8c58-6277-4db4-b37f-c502429d9a01 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:58.066377 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG dbcounter [-] [127032] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:52:58.183176 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-95af8c58-6277-4db4-b37f-c502429d9a01 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:58.191218 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-95af8c58-6277-4db4-b37f-c502429d9a01 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:58.192665 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-95af8c58-6277-4db4-b37f-c502429d9a01 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:58.193816 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-95af8c58-6277-4db4-b37f-c502429d9a01 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827" status: 200 len: 1742 microversion: 2.20 time: 0.158875 Oct 28 09:52:58.194365 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 361/711] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:52:58 2022] GET /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827 => generated 1742 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:52:59.220041 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-25b5a801-5b86-4cee-a054-55dede1ddb65 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:59.220652 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-25b5a801-5b86-4cee-a054-55dede1ddb65 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 125194a5-e664-4ea8-ad7e-b0ae1b54e827] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:59.226981 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-25b5a801-5b86-4cee-a054-55dede1ddb65 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:59.227466 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-25b5a801-5b86-4cee-a054-55dede1ddb65 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:59.227944 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-25b5a801-5b86-4cee-a054-55dede1ddb65 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:59.228639 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-25b5a801-5b86-4cee-a054-55dede1ddb65 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:59.229103 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-25b5a801-5b86-4cee-a054-55dede1ddb65 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:59.229529 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-25b5a801-5b86-4cee-a054-55dede1ddb65 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:59.356058 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-25b5a801-5b86-4cee-a054-55dede1ddb65 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:59.364074 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-25b5a801-5b86-4cee-a054-55dede1ddb65 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:59.365795 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-25b5a801-5b86-4cee-a054-55dede1ddb65 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:59.366950 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-25b5a801-5b86-4cee-a054-55dede1ddb65 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827" status: 200 len: 1742 microversion: 2.20 time: 0.150900 Oct 28 09:52:59.367515 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 351/712] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:52:59 2022] GET /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827 => generated 1742 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:53:00.393318 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-6c9673e9-149c-411e-92a7-ddbba7f7d5a5 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:00.393903 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-6c9673e9-149c-411e-92a7-ddbba7f7d5a5 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 125194a5-e664-4ea8-ad7e-b0ae1b54e827] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:00.400960 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-6c9673e9-149c-411e-92a7-ddbba7f7d5a5 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:00.401454 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-6c9673e9-149c-411e-92a7-ddbba7f7d5a5 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:00.402519 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-6c9673e9-149c-411e-92a7-ddbba7f7d5a5 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:00.403230 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-6c9673e9-149c-411e-92a7-ddbba7f7d5a5 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:00.403692 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-6c9673e9-149c-411e-92a7-ddbba7f7d5a5 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:00.404144 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-6c9673e9-149c-411e-92a7-ddbba7f7d5a5 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:00.543689 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-6c9673e9-149c-411e-92a7-ddbba7f7d5a5 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:00.551961 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-6c9673e9-149c-411e-92a7-ddbba7f7d5a5 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:00.553422 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-6c9673e9-149c-411e-92a7-ddbba7f7d5a5 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:00.554729 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-6c9673e9-149c-411e-92a7-ddbba7f7d5a5 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827" status: 200 len: 1742 microversion: 2.20 time: 0.165454 Oct 28 09:53:00.555291 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 362/713] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:53:00 2022] GET /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827 => generated 1742 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:53:01.581393 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-ceee03fb-57f2-4a97-9f16-452f49bcaec6 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:01.582000 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-ceee03fb-57f2-4a97-9f16-452f49bcaec6 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 125194a5-e664-4ea8-ad7e-b0ae1b54e827] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:01.588561 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-ceee03fb-57f2-4a97-9f16-452f49bcaec6 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:01.589050 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-ceee03fb-57f2-4a97-9f16-452f49bcaec6 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:01.589489 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-ceee03fb-57f2-4a97-9f16-452f49bcaec6 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:01.590177 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-ceee03fb-57f2-4a97-9f16-452f49bcaec6 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:01.590633 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-ceee03fb-57f2-4a97-9f16-452f49bcaec6 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:01.591058 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-ceee03fb-57f2-4a97-9f16-452f49bcaec6 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:01.721521 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-ceee03fb-57f2-4a97-9f16-452f49bcaec6 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:01.729526 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-ceee03fb-57f2-4a97-9f16-452f49bcaec6 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:01.731464 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-ceee03fb-57f2-4a97-9f16-452f49bcaec6 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:01.732683 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-ceee03fb-57f2-4a97-9f16-452f49bcaec6 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827" status: 200 len: 1742 microversion: 2.20 time: 0.155286 Oct 28 09:53:01.733256 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 352/714] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:53:01 2022] GET /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827 => generated 1742 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:53:02.260464 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [req-d9545609-08cd-40bf-a17d-5e823db1a42a req-ae612405-e967-433a-ac45-318fb9073374 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "125194a5-e664-4ea8-ad7e-b0ae1b54e827", "name": "network-vif-plugged", "status": "completed", "tag": "ff843068-026c-460b-ae99-a8c3ca1fb539"}]} {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:53:02.270771 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-d9545609-08cd-40bf-a17d-5e823db1a42a req-ae612405-e967-433a-ac45-318fb9073374 service nova] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:02.271249 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-d9545609-08cd-40bf-a17d-5e823db1a42a req-ae612405-e967-433a-ac45-318fb9073374 service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:02.271763 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-d9545609-08cd-40bf-a17d-5e823db1a42a req-ae612405-e967-433a-ac45-318fb9073374 service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:02.283853 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.compute.server_external_events [req-d9545609-08cd-40bf-a17d-5e823db1a42a req-ae612405-e967-433a-ac45-318fb9073374 service nova] Creating event network-vif-plugged:ff843068-026c-460b-ae99-a8c3ca1fb539 for instance 125194a5-e664-4ea8-ad7e-b0ae1b54e827 on hv-cinder-zed-3 Oct 28 09:53:02.288920 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [req-d9545609-08cd-40bf-a17d-5e823db1a42a req-ae612405-e967-433a-ac45-318fb9073374 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032310 Oct 28 09:53:02.289612 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 363/715] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Oct 28 09:53:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:53:02.758431 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-7aa398e4-21b4-4981-91d8-38c9fab4a5f4 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:02.759033 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-7aa398e4-21b4-4981-91d8-38c9fab4a5f4 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 125194a5-e664-4ea8-ad7e-b0ae1b54e827] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:02.765400 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-7aa398e4-21b4-4981-91d8-38c9fab4a5f4 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:02.765883 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-7aa398e4-21b4-4981-91d8-38c9fab4a5f4 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:02.766311 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-7aa398e4-21b4-4981-91d8-38c9fab4a5f4 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:02.766992 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-7aa398e4-21b4-4981-91d8-38c9fab4a5f4 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:02.767442 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-7aa398e4-21b4-4981-91d8-38c9fab4a5f4 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:02.767898 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-7aa398e4-21b4-4981-91d8-38c9fab4a5f4 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:02.899132 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-7aa398e4-21b4-4981-91d8-38c9fab4a5f4 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:02.903137 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG dbcounter [-] [127033] Writing DB stats nova_cell1:SELECT=100 {{(pid=127033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:53:02.908653 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-7aa398e4-21b4-4981-91d8-38c9fab4a5f4 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:02.910087 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-7aa398e4-21b4-4981-91d8-38c9fab4a5f4 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:02.911401 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-7aa398e4-21b4-4981-91d8-38c9fab4a5f4 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827" status: 200 len: 1742 microversion: 2.20 time: 0.156877 Oct 28 09:53:02.912117 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 353/716] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:53:02 2022] GET /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827 => generated 1742 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:53:03.938698 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-34ae5254-d553-437d-96e1-b0fe489e3061 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:03.939383 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-34ae5254-d553-437d-96e1-b0fe489e3061 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 125194a5-e664-4ea8-ad7e-b0ae1b54e827] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:03.945578 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-34ae5254-d553-437d-96e1-b0fe489e3061 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:03.946066 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-34ae5254-d553-437d-96e1-b0fe489e3061 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:03.946505 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-34ae5254-d553-437d-96e1-b0fe489e3061 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:03.947195 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-34ae5254-d553-437d-96e1-b0fe489e3061 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:03.947652 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-34ae5254-d553-437d-96e1-b0fe489e3061 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:03.948101 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-34ae5254-d553-437d-96e1-b0fe489e3061 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:04.081513 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-34ae5254-d553-437d-96e1-b0fe489e3061 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:04.089431 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-34ae5254-d553-437d-96e1-b0fe489e3061 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:04.091551 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-34ae5254-d553-437d-96e1-b0fe489e3061 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:04.092728 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-34ae5254-d553-437d-96e1-b0fe489e3061 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827" status: 200 len: 1742 microversion: 2.20 time: 0.158893 Oct 28 09:53:04.093288 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 364/717] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:53:03 2022] GET /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827 => generated 1742 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:53:05.117988 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-7266bd39-1b54-4874-b3d1-ea075f449e74 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:05.118521 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-7266bd39-1b54-4874-b3d1-ea075f449e74 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 125194a5-e664-4ea8-ad7e-b0ae1b54e827] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:05.126133 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-7266bd39-1b54-4874-b3d1-ea075f449e74 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:05.126621 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-7266bd39-1b54-4874-b3d1-ea075f449e74 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:05.127063 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-7266bd39-1b54-4874-b3d1-ea075f449e74 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:05.127779 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-7266bd39-1b54-4874-b3d1-ea075f449e74 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:05.128240 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-7266bd39-1b54-4874-b3d1-ea075f449e74 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:05.128668 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-7266bd39-1b54-4874-b3d1-ea075f449e74 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:05.257154 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-7266bd39-1b54-4874-b3d1-ea075f449e74 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:05.264701 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-7266bd39-1b54-4874-b3d1-ea075f449e74 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:05.266131 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-7266bd39-1b54-4874-b3d1-ea075f449e74 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:05.267290 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-7266bd39-1b54-4874-b3d1-ea075f449e74 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827" status: 200 len: 1742 microversion: 2.20 time: 0.153569 Oct 28 09:53:05.267878 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 354/718] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:53:05 2022] GET /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827 => generated 1742 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:53:06.293459 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-bb8f82ca-c7ec-42d0-8119-06d56459a436 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:06.294081 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-bb8f82ca-c7ec-42d0-8119-06d56459a436 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 125194a5-e664-4ea8-ad7e-b0ae1b54e827] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:06.300247 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-bb8f82ca-c7ec-42d0-8119-06d56459a436 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:06.300728 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-bb8f82ca-c7ec-42d0-8119-06d56459a436 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:06.301342 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-bb8f82ca-c7ec-42d0-8119-06d56459a436 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:06.302035 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-bb8f82ca-c7ec-42d0-8119-06d56459a436 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:06.302488 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-bb8f82ca-c7ec-42d0-8119-06d56459a436 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:06.302905 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-bb8f82ca-c7ec-42d0-8119-06d56459a436 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:06.443456 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-bb8f82ca-c7ec-42d0-8119-06d56459a436 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:06.453613 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-bb8f82ca-c7ec-42d0-8119-06d56459a436 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:06.455382 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-bb8f82ca-c7ec-42d0-8119-06d56459a436 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:06.456948 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-bb8f82ca-c7ec-42d0-8119-06d56459a436 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827" status: 200 len: 1737 microversion: 2.20 time: 0.167902 Oct 28 09:53:06.475617 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 365/719] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:53:06 2022] GET /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827 => generated 1737 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:53:07.483530 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-3b5b7a97-0868-4de7-959b-0afe6e26e903 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:07.484181 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-3b5b7a97-0868-4de7-959b-0afe6e26e903 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 125194a5-e664-4ea8-ad7e-b0ae1b54e827] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:07.494723 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-3b5b7a97-0868-4de7-959b-0afe6e26e903 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:07.495369 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-3b5b7a97-0868-4de7-959b-0afe6e26e903 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:07.496590 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-3b5b7a97-0868-4de7-959b-0afe6e26e903 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:07.497305 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-3b5b7a97-0868-4de7-959b-0afe6e26e903 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:07.497776 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-3b5b7a97-0868-4de7-959b-0afe6e26e903 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:07.498198 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-3b5b7a97-0868-4de7-959b-0afe6e26e903 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:07.648635 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-3b5b7a97-0868-4de7-959b-0afe6e26e903 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:07.658603 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-3b5b7a97-0868-4de7-959b-0afe6e26e903 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:07.661019 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-3b5b7a97-0868-4de7-959b-0afe6e26e903 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:07.662138 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-3b5b7a97-0868-4de7-959b-0afe6e26e903 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827" status: 200 len: 1737 microversion: 2.20 time: 0.183373 Oct 28 09:53:07.662716 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 355/720] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:53:07 2022] GET /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827 => generated 1737 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:53:08.690694 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-c49b814a-c545-456c-9fc9-7a17251cc7dc tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:08.691315 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-c49b814a-c545-456c-9fc9-7a17251cc7dc tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 125194a5-e664-4ea8-ad7e-b0ae1b54e827] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:08.697781 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-c49b814a-c545-456c-9fc9-7a17251cc7dc tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:08.698273 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-c49b814a-c545-456c-9fc9-7a17251cc7dc tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:08.698707 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-c49b814a-c545-456c-9fc9-7a17251cc7dc tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:08.699974 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-c49b814a-c545-456c-9fc9-7a17251cc7dc tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:08.700425 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-c49b814a-c545-456c-9fc9-7a17251cc7dc tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:08.700921 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-c49b814a-c545-456c-9fc9-7a17251cc7dc tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:08.843388 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-c49b814a-c545-456c-9fc9-7a17251cc7dc tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:08.852045 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-c49b814a-c545-456c-9fc9-7a17251cc7dc tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:08.854657 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-c49b814a-c545-456c-9fc9-7a17251cc7dc tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:08.856386 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-c49b814a-c545-456c-9fc9-7a17251cc7dc tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827" status: 200 len: 1737 microversion: 2.20 time: 0.169970 Oct 28 09:53:08.857075 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 366/721] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:53:08 2022] GET /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827 => generated 1737 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:53:09.889842 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-fbe883f8-8cab-4832-a0a7-b313420198d8 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:09.889842 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-fbe883f8-8cab-4832-a0a7-b313420198d8 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 125194a5-e664-4ea8-ad7e-b0ae1b54e827] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:09.891729 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG dbcounter [-] [127033] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=127033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:53:09.897878 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-fbe883f8-8cab-4832-a0a7-b313420198d8 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:09.898405 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-fbe883f8-8cab-4832-a0a7-b313420198d8 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:09.898839 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-fbe883f8-8cab-4832-a0a7-b313420198d8 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:09.899542 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-fbe883f8-8cab-4832-a0a7-b313420198d8 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:09.900031 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-fbe883f8-8cab-4832-a0a7-b313420198d8 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:09.900459 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-fbe883f8-8cab-4832-a0a7-b313420198d8 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:10.045055 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-fbe883f8-8cab-4832-a0a7-b313420198d8 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:10.054821 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-fbe883f8-8cab-4832-a0a7-b313420198d8 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:10.056676 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-fbe883f8-8cab-4832-a0a7-b313420198d8 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:10.058066 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-fbe883f8-8cab-4832-a0a7-b313420198d8 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827" status: 200 len: 1737 microversion: 2.20 time: 0.173931 Oct 28 09:53:10.059431 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 356/722] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:53:09 2022] GET /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827 => generated 1737 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:53:11.085196 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-9bd961c0-290a-4ea6-8b03-4e9eb9046c19 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:11.085769 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-9bd961c0-290a-4ea6-8b03-4e9eb9046c19 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 125194a5-e664-4ea8-ad7e-b0ae1b54e827] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:11.088321 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG dbcounter [-] [127032] Writing DB stats nova_api:SELECT=40 {{(pid=127032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:53:11.095067 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-9bd961c0-290a-4ea6-8b03-4e9eb9046c19 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:11.095558 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-9bd961c0-290a-4ea6-8b03-4e9eb9046c19 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:11.096023 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-9bd961c0-290a-4ea6-8b03-4e9eb9046c19 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:11.096727 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-9bd961c0-290a-4ea6-8b03-4e9eb9046c19 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:11.097177 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-9bd961c0-290a-4ea6-8b03-4e9eb9046c19 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:11.097875 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-9bd961c0-290a-4ea6-8b03-4e9eb9046c19 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:11.243709 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-9bd961c0-290a-4ea6-8b03-4e9eb9046c19 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:11.253167 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-9bd961c0-290a-4ea6-8b03-4e9eb9046c19 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:11.254691 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-9bd961c0-290a-4ea6-8b03-4e9eb9046c19 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:11.255821 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-9bd961c0-290a-4ea6-8b03-4e9eb9046c19 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827" status: 200 len: 1737 microversion: 2.20 time: 0.175160 Oct 28 09:53:11.256382 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 367/723] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:53:11 2022] GET /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827 => generated 1737 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:53:12.283173 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-9ccae45b-748a-4b79-9a5b-84614d4ecea7 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:12.283963 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-9ccae45b-748a-4b79-9a5b-84614d4ecea7 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 125194a5-e664-4ea8-ad7e-b0ae1b54e827] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:12.291083 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-9ccae45b-748a-4b79-9a5b-84614d4ecea7 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:12.291579 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-9ccae45b-748a-4b79-9a5b-84614d4ecea7 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:12.292125 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-9ccae45b-748a-4b79-9a5b-84614d4ecea7 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:12.292834 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-9ccae45b-748a-4b79-9a5b-84614d4ecea7 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:12.293288 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-9ccae45b-748a-4b79-9a5b-84614d4ecea7 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:12.293714 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-9ccae45b-748a-4b79-9a5b-84614d4ecea7 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:12.440955 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-9ccae45b-748a-4b79-9a5b-84614d4ecea7 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:12.452418 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-9ccae45b-748a-4b79-9a5b-84614d4ecea7 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:12.455119 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-9ccae45b-748a-4b79-9a5b-84614d4ecea7 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:12.456371 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-9ccae45b-748a-4b79-9a5b-84614d4ecea7 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827" status: 200 len: 1737 microversion: 2.20 time: 0.178154 Oct 28 09:53:12.457246 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 357/724] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:53:12 2022] GET /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827 => generated 1737 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:53:13.483100 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-ae5cbbb0-ce25-4054-b214-9eff060d5418 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:13.483825 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-ae5cbbb0-ce25-4054-b214-9eff060d5418 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 125194a5-e664-4ea8-ad7e-b0ae1b54e827] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:13.490471 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ae5cbbb0-ce25-4054-b214-9eff060d5418 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:13.490954 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ae5cbbb0-ce25-4054-b214-9eff060d5418 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:13.491409 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ae5cbbb0-ce25-4054-b214-9eff060d5418 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:13.492135 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ae5cbbb0-ce25-4054-b214-9eff060d5418 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:13.492675 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ae5cbbb0-ce25-4054-b214-9eff060d5418 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:13.493127 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ae5cbbb0-ce25-4054-b214-9eff060d5418 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:13.640402 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-ae5cbbb0-ce25-4054-b214-9eff060d5418 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:13.649427 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-ae5cbbb0-ce25-4054-b214-9eff060d5418 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:13.650920 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-ae5cbbb0-ce25-4054-b214-9eff060d5418 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:13.652683 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-ae5cbbb0-ce25-4054-b214-9eff060d5418 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827" status: 200 len: 1737 microversion: 2.20 time: 0.173701 Oct 28 09:53:13.653660 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 368/725] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:53:13 2022] GET /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827 => generated 1737 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:53:14.680994 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-92dba459-92a6-425c-a8ac-03f6f549a53c tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:14.682044 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-92dba459-92a6-425c-a8ac-03f6f549a53c tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 125194a5-e664-4ea8-ad7e-b0ae1b54e827] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:14.690822 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-92dba459-92a6-425c-a8ac-03f6f549a53c tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:14.691814 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-92dba459-92a6-425c-a8ac-03f6f549a53c tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:14.692507 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-92dba459-92a6-425c-a8ac-03f6f549a53c tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:14.693532 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-92dba459-92a6-425c-a8ac-03f6f549a53c tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:14.694069 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-92dba459-92a6-425c-a8ac-03f6f549a53c tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:14.694966 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-92dba459-92a6-425c-a8ac-03f6f549a53c tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:14.848893 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-92dba459-92a6-425c-a8ac-03f6f549a53c tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:14.857885 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-92dba459-92a6-425c-a8ac-03f6f549a53c tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:14.859337 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-92dba459-92a6-425c-a8ac-03f6f549a53c tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:14.860601 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-92dba459-92a6-425c-a8ac-03f6f549a53c tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827" status: 200 len: 1737 microversion: 2.20 time: 0.185009 Oct 28 09:53:14.861380 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 358/726] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:53:14 2022] GET /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827 => generated 1737 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:53:15.888837 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-e1c63cd7-e494-49c0-8363-8e4c45673121 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:15.889346 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-e1c63cd7-e494-49c0-8363-8e4c45673121 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 125194a5-e664-4ea8-ad7e-b0ae1b54e827] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:15.895729 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-e1c63cd7-e494-49c0-8363-8e4c45673121 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:15.896266 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-e1c63cd7-e494-49c0-8363-8e4c45673121 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:15.896697 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-e1c63cd7-e494-49c0-8363-8e4c45673121 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:15.897385 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-e1c63cd7-e494-49c0-8363-8e4c45673121 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:15.897836 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-e1c63cd7-e494-49c0-8363-8e4c45673121 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:15.898257 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-e1c63cd7-e494-49c0-8363-8e4c45673121 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:16.032130 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-e1c63cd7-e494-49c0-8363-8e4c45673121 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:16.040223 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-e1c63cd7-e494-49c0-8363-8e4c45673121 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:16.041867 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-e1c63cd7-e494-49c0-8363-8e4c45673121 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:16.043547 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-e1c63cd7-e494-49c0-8363-8e4c45673121 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827" status: 200 len: 1737 microversion: 2.20 time: 0.158719 Oct 28 09:53:16.044133 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 369/727] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:53:15 2022] GET /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827 => generated 1737 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:53:17.069853 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-cfade364-30c7-4b47-8aa3-35269db12c36 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:17.070462 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-cfade364-30c7-4b47-8aa3-35269db12c36 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 125194a5-e664-4ea8-ad7e-b0ae1b54e827] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:17.077476 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-cfade364-30c7-4b47-8aa3-35269db12c36 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:17.077964 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-cfade364-30c7-4b47-8aa3-35269db12c36 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:17.078400 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-cfade364-30c7-4b47-8aa3-35269db12c36 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:17.079091 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-cfade364-30c7-4b47-8aa3-35269db12c36 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:17.079555 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-cfade364-30c7-4b47-8aa3-35269db12c36 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:17.080013 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-cfade364-30c7-4b47-8aa3-35269db12c36 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:17.214999 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-cfade364-30c7-4b47-8aa3-35269db12c36 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:17.223233 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-cfade364-30c7-4b47-8aa3-35269db12c36 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:17.224726 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-cfade364-30c7-4b47-8aa3-35269db12c36 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:17.225894 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-cfade364-30c7-4b47-8aa3-35269db12c36 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827" status: 200 len: 1719 microversion: 2.20 time: 0.159970 Oct 28 09:53:17.226464 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 359/728] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:53:17 2022] GET /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827 => generated 1719 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:53:18.251064 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-ee4ba608-15d3-410e-8e8f-db3868180b64 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:18.251675 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-ee4ba608-15d3-410e-8e8f-db3868180b64 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 125194a5-e664-4ea8-ad7e-b0ae1b54e827] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:18.258136 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ee4ba608-15d3-410e-8e8f-db3868180b64 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:18.258615 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ee4ba608-15d3-410e-8e8f-db3868180b64 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:18.259050 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ee4ba608-15d3-410e-8e8f-db3868180b64 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:18.259738 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ee4ba608-15d3-410e-8e8f-db3868180b64 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:18.260358 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ee4ba608-15d3-410e-8e8f-db3868180b64 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:18.260690 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ee4ba608-15d3-410e-8e8f-db3868180b64 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:18.389400 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-ee4ba608-15d3-410e-8e8f-db3868180b64 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:18.397445 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-ee4ba608-15d3-410e-8e8f-db3868180b64 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:18.398801 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-ee4ba608-15d3-410e-8e8f-db3868180b64 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:18.399968 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-ee4ba608-15d3-410e-8e8f-db3868180b64 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827" status: 200 len: 1719 microversion: 2.20 time: 0.152858 Oct 28 09:53:18.400528 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 370/729] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:53:18 2022] GET /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827 => generated 1719 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:53:19.425903 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-3d5a0f14-8ccd-40ba-8a68-f744bae12ea2 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:19.426513 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-3d5a0f14-8ccd-40ba-8a68-f744bae12ea2 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 125194a5-e664-4ea8-ad7e-b0ae1b54e827] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:19.432638 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-3d5a0f14-8ccd-40ba-8a68-f744bae12ea2 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:19.433121 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-3d5a0f14-8ccd-40ba-8a68-f744bae12ea2 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:19.433553 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-3d5a0f14-8ccd-40ba-8a68-f744bae12ea2 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:19.434259 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-3d5a0f14-8ccd-40ba-8a68-f744bae12ea2 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:19.434716 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-3d5a0f14-8ccd-40ba-8a68-f744bae12ea2 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:19.435141 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-3d5a0f14-8ccd-40ba-8a68-f744bae12ea2 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:19.565185 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-3d5a0f14-8ccd-40ba-8a68-f744bae12ea2 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:19.573265 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-3d5a0f14-8ccd-40ba-8a68-f744bae12ea2 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:19.574729 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-3d5a0f14-8ccd-40ba-8a68-f744bae12ea2 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:19.575946 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-3d5a0f14-8ccd-40ba-8a68-f744bae12ea2 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827" status: 200 len: 1662 microversion: 2.20 time: 0.154114 Oct 28 09:53:19.576513 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 360/730] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:53:19 2022] GET /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827 => generated 1662 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:53:19.601541 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-b8273480-a300-4252-8948-cfe2d34c64fd tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1d900ff6-2593-444d-abe6-b1ef94ef8b08"}} {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:53:19.603993 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-b8273480-a300-4252-8948-cfe2d34c64fd tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 125194a5-e664-4ea8-ad7e-b0ae1b54e827] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:19.611030 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-b8273480-a300-4252-8948-cfe2d34c64fd tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:19.611513 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-b8273480-a300-4252-8948-cfe2d34c64fd tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:19.611981 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-b8273480-a300-4252-8948-cfe2d34c64fd tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:19.612675 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-b8273480-a300-4252-8948-cfe2d34c64fd tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:19.613132 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-b8273480-a300-4252-8948-cfe2d34c64fd tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:19.613556 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-b8273480-a300-4252-8948-cfe2d34c64fd tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:19.880943 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-b8273480-a300-4252-8948-cfe2d34c64fd tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "POST /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.283523 Oct 28 09:53:19.881824 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 371/731] 10.222.0.52 () {62 vars in 1364 bytes} [Fri Oct 28 09:53:19 2022] POST /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827/os-volume_attachments => generated 188 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 09:53:20.007413 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-79f2c199-c07f-4849-89dd-10e768a57541 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:20.007926 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-79f2c199-c07f-4849-89dd-10e768a57541 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 125194a5-e664-4ea8-ad7e-b0ae1b54e827] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:20.014422 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-79f2c199-c07f-4849-89dd-10e768a57541 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:20.014898 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-79f2c199-c07f-4849-89dd-10e768a57541 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:20.015324 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-79f2c199-c07f-4849-89dd-10e768a57541 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:20.016041 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-79f2c199-c07f-4849-89dd-10e768a57541 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:20.016490 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-79f2c199-c07f-4849-89dd-10e768a57541 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:20.016906 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-79f2c199-c07f-4849-89dd-10e768a57541 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:20.261626 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-79f2c199-c07f-4849-89dd-10e768a57541 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "DELETE /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827/os-volume_attachments/1d900ff6-2593-444d-abe6-b1ef94ef8b08" status: 202 len: 0 microversion: 2.20 time: 0.258120 Oct 28 09:53:20.262882 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 361/732] 10.222.0.52 () {60 vars in 1457 bytes} [Fri Oct 28 09:53:20 2022] DELETE /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827/os-volume_attachments/1d900ff6-2593-444d-abe6-b1ef94ef8b08 => generated 0 bytes in 260 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 28 09:53:20.323991 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-0cacfa37-3b12-41ab-8344-3af10c926181 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:53:20.325466 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-0cacfa37-3b12-41ab-8344-3af10c926181 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 125194a5-e664-4ea8-ad7e-b0ae1b54e827] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:20.325694 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [req-a21eae7e-a755-41dc-8da0-835dbf092961 req-e8268623-afef-4c39-84c1-d8a7397ba302 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "125194a5-e664-4ea8-ad7e-b0ae1b54e827", "name": "network-vif-unplugged", "status": "completed", "tag": "ff843068-026c-460b-ae99-a8c3ca1fb539"}]} {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:53:20.332166 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-0cacfa37-3b12-41ab-8344-3af10c926181 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:20.332673 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-0cacfa37-3b12-41ab-8344-3af10c926181 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:20.333109 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-0cacfa37-3b12-41ab-8344-3af10c926181 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:20.334075 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-0cacfa37-3b12-41ab-8344-3af10c926181 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:20.334437 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-0cacfa37-3b12-41ab-8344-3af10c926181 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:20.334869 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-0cacfa37-3b12-41ab-8344-3af10c926181 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:20.338869 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-a21eae7e-a755-41dc-8da0-835dbf092961 req-e8268623-afef-4c39-84c1-d8a7397ba302 service nova] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:20.339353 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-a21eae7e-a755-41dc-8da0-835dbf092961 req-e8268623-afef-4c39-84c1-d8a7397ba302 service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:20.339820 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-a21eae7e-a755-41dc-8da0-835dbf092961 req-e8268623-afef-4c39-84c1-d8a7397ba302 service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:20.351178 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.compute.server_external_events [req-a21eae7e-a755-41dc-8da0-835dbf092961 req-e8268623-afef-4c39-84c1-d8a7397ba302 service nova] Unable to find a host for instance 125194a5-e664-4ea8-ad7e-b0ae1b54e827. Dropping event network-vif-unplugged {{(pid=127033) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 28 09:53:20.352122 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [req-a21eae7e-a755-41dc-8da0-835dbf092961 req-e8268623-afef-4c39-84c1-d8a7397ba302 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.031957 Oct 28 09:53:20.352731 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 362/733] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Oct 28 09:53:20 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 33 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 28 09:53:20.381807 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-0cacfa37-3b12-41ab-8344-3af10c926181 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 125194a5-e664-4ea8-ad7e-b0ae1b54e827] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127032) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 28 09:53:20.448918 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-0cacfa37-3b12-41ab-8344-3af10c926181 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "POST /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827/action" status: 202 len: 0 microversion: 2.20 time: 0.128832 Oct 28 09:53:20.449518 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 372/734] 10.222.0.52 () {62 vars in 1319 bytes} [Fri Oct 28 09:53:20 2022] POST /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 28 09:53:20.457758 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-aed8790d-7d24-4ee7-8543-1762e08dae42 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:20.458480 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-aed8790d-7d24-4ee7-8543-1762e08dae42 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 125194a5-e664-4ea8-ad7e-b0ae1b54e827] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:20.465213 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-aed8790d-7d24-4ee7-8543-1762e08dae42 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:20.465916 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-aed8790d-7d24-4ee7-8543-1762e08dae42 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:20.466352 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-aed8790d-7d24-4ee7-8543-1762e08dae42 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:20.467201 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-aed8790d-7d24-4ee7-8543-1762e08dae42 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:20.467877 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-aed8790d-7d24-4ee7-8543-1762e08dae42 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:20.468372 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-aed8790d-7d24-4ee7-8543-1762e08dae42 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:20.632727 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-aed8790d-7d24-4ee7-8543-1762e08dae42 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:20.641561 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-aed8790d-7d24-4ee7-8543-1762e08dae42 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:20.643021 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-aed8790d-7d24-4ee7-8543-1762e08dae42 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:20.644279 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-aed8790d-7d24-4ee7-8543-1762e08dae42 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827" status: 200 len: 1670 microversion: 2.20 time: 0.190440 Oct 28 09:53:20.644827 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 363/735] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:53:20 2022] GET /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827 => generated 1670 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:53:21.670384 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-ee7fcacc-3b11-4fa0-bd0e-d80ee539bca1 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:21.671068 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-ee7fcacc-3b11-4fa0-bd0e-d80ee539bca1 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 125194a5-e664-4ea8-ad7e-b0ae1b54e827] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:21.676872 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ee7fcacc-3b11-4fa0-bd0e-d80ee539bca1 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:21.677362 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ee7fcacc-3b11-4fa0-bd0e-d80ee539bca1 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:21.677817 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ee7fcacc-3b11-4fa0-bd0e-d80ee539bca1 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:21.678614 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ee7fcacc-3b11-4fa0-bd0e-d80ee539bca1 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:21.678950 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ee7fcacc-3b11-4fa0-bd0e-d80ee539bca1 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:21.679372 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ee7fcacc-3b11-4fa0-bd0e-d80ee539bca1 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:21.812729 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-ee7fcacc-3b11-4fa0-bd0e-d80ee539bca1 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:21.820931 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-ee7fcacc-3b11-4fa0-bd0e-d80ee539bca1 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:21.822372 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-ee7fcacc-3b11-4fa0-bd0e-d80ee539bca1 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:21.823712 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-ee7fcacc-3b11-4fa0-bd0e-d80ee539bca1 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827" status: 200 len: 1728 microversion: 2.20 time: 0.157754 Oct 28 09:53:21.824303 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 373/736] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:53:21 2022] GET /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827 => generated 1728 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:53:22.849257 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-17e477c0-6222-4f36-bf68-65fa19410ef3 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:22.850005 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-17e477c0-6222-4f36-bf68-65fa19410ef3 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 125194a5-e664-4ea8-ad7e-b0ae1b54e827] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:22.856936 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-17e477c0-6222-4f36-bf68-65fa19410ef3 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:22.857394 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-17e477c0-6222-4f36-bf68-65fa19410ef3 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:22.857838 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-17e477c0-6222-4f36-bf68-65fa19410ef3 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:22.858510 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-17e477c0-6222-4f36-bf68-65fa19410ef3 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:22.859043 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-17e477c0-6222-4f36-bf68-65fa19410ef3 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:22.859368 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-17e477c0-6222-4f36-bf68-65fa19410ef3 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:23.000592 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-17e477c0-6222-4f36-bf68-65fa19410ef3 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:23.008609 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-17e477c0-6222-4f36-bf68-65fa19410ef3 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:23.010057 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-17e477c0-6222-4f36-bf68-65fa19410ef3 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:23.011212 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-17e477c0-6222-4f36-bf68-65fa19410ef3 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827" status: 200 len: 1728 microversion: 2.20 time: 0.166133 Oct 28 09:53:23.011838 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 364/737] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:53:22 2022] GET /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827 => generated 1728 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:53:24.036992 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-7af8ac39-6f2d-4f8a-944d-0822750210f3 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:24.037642 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-7af8ac39-6f2d-4f8a-944d-0822750210f3 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 125194a5-e664-4ea8-ad7e-b0ae1b54e827] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:24.044498 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-7af8ac39-6f2d-4f8a-944d-0822750210f3 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:24.045000 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-7af8ac39-6f2d-4f8a-944d-0822750210f3 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:24.045437 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-7af8ac39-6f2d-4f8a-944d-0822750210f3 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:24.046144 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-7af8ac39-6f2d-4f8a-944d-0822750210f3 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:24.046608 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-7af8ac39-6f2d-4f8a-944d-0822750210f3 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:24.047036 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-7af8ac39-6f2d-4f8a-944d-0822750210f3 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:24.196380 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-7af8ac39-6f2d-4f8a-944d-0822750210f3 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:24.205688 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-7af8ac39-6f2d-4f8a-944d-0822750210f3 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:24.207507 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-7af8ac39-6f2d-4f8a-944d-0822750210f3 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:24.208846 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-7af8ac39-6f2d-4f8a-944d-0822750210f3 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827" status: 200 len: 1728 microversion: 2.20 time: 0.175731 Oct 28 09:53:24.209951 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 374/738] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:53:24 2022] GET /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827 => generated 1728 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:53:25.234818 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-922f3a97-3f91-4e69-a009-c1bf515a7037 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:25.235415 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-922f3a97-3f91-4e69-a009-c1bf515a7037 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 125194a5-e664-4ea8-ad7e-b0ae1b54e827] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:25.242202 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-922f3a97-3f91-4e69-a009-c1bf515a7037 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:25.242688 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-922f3a97-3f91-4e69-a009-c1bf515a7037 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:25.243116 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-922f3a97-3f91-4e69-a009-c1bf515a7037 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:25.243829 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-922f3a97-3f91-4e69-a009-c1bf515a7037 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:25.244277 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-922f3a97-3f91-4e69-a009-c1bf515a7037 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:25.244693 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-922f3a97-3f91-4e69-a009-c1bf515a7037 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:25.383992 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-922f3a97-3f91-4e69-a009-c1bf515a7037 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:25.393420 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-922f3a97-3f91-4e69-a009-c1bf515a7037 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:25.394857 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-922f3a97-3f91-4e69-a009-c1bf515a7037 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:25.396054 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-922f3a97-3f91-4e69-a009-c1bf515a7037 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827" status: 200 len: 1728 microversion: 2.20 time: 0.165166 Oct 28 09:53:25.396679 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 365/739] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:53:25 2022] GET /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827 => generated 1728 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:53:26.423310 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-2833ef6a-90d4-42bb-9125-678bfd158368 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:26.423874 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-2833ef6a-90d4-42bb-9125-678bfd158368 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 125194a5-e664-4ea8-ad7e-b0ae1b54e827] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:26.430362 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-2833ef6a-90d4-42bb-9125-678bfd158368 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:26.430852 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-2833ef6a-90d4-42bb-9125-678bfd158368 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:26.431293 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-2833ef6a-90d4-42bb-9125-678bfd158368 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:26.432095 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-2833ef6a-90d4-42bb-9125-678bfd158368 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:26.432551 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-2833ef6a-90d4-42bb-9125-678bfd158368 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:26.432969 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-2833ef6a-90d4-42bb-9125-678bfd158368 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:26.437885 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG dbcounter [-] [127032] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=127032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:53:26.575738 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-2833ef6a-90d4-42bb-9125-678bfd158368 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:26.583701 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-2833ef6a-90d4-42bb-9125-678bfd158368 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:26.585144 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-2833ef6a-90d4-42bb-9125-678bfd158368 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:26.586286 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-2833ef6a-90d4-42bb-9125-678bfd158368 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827" status: 200 len: 1728 microversion: 2.20 time: 0.167725 Oct 28 09:53:26.586843 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 375/740] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:53:26 2022] GET /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827 => generated 1728 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:53:27.217146 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-e1840246-0381-4fb7-936b-5694d9888d42 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:27.217777 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-e1840246-0381-4fb7-936b-5694d9888d42 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] [instance: ae78bc7d-2e36-42d6-bcef-686291983088] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:27.224249 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-e1840246-0381-4fb7-936b-5694d9888d42 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:27.224634 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-e1840246-0381-4fb7-936b-5694d9888d42 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:27.225070 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-e1840246-0381-4fb7-936b-5694d9888d42 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:27.225766 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-e1840246-0381-4fb7-936b-5694d9888d42 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:27.226221 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-e1840246-0381-4fb7-936b-5694d9888d42 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:27.226643 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-e1840246-0381-4fb7-936b-5694d9888d42 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:27.253604 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-e1840246-0381-4fb7-936b-5694d9888d42 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] 10.222.0.52 "GET /compute/v2.1/servers/ae78bc7d-2e36-42d6-bcef-686291983088/ips" status: 200 len: 145 microversion: 2.1 time: 0.040698 Oct 28 09:53:27.254278 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 366/741] 10.222.0.52 () {58 vars in 1248 bytes} [Fri Oct 28 09:53:27 2022] GET /compute/v2.1/servers/ae78bc7d-2e36-42d6-bcef-686291983088/ips => generated 145 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:53:27.614729 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-96fb04c1-9e48-4468-ac98-73099a5762ab tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:27.615581 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-96fb04c1-9e48-4468-ac98-73099a5762ab tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 125194a5-e664-4ea8-ad7e-b0ae1b54e827] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:27.623320 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-96fb04c1-9e48-4468-ac98-73099a5762ab tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:27.623842 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-96fb04c1-9e48-4468-ac98-73099a5762ab tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:27.624279 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-96fb04c1-9e48-4468-ac98-73099a5762ab tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:27.625202 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-96fb04c1-9e48-4468-ac98-73099a5762ab tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:27.625660 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-96fb04c1-9e48-4468-ac98-73099a5762ab tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:27.626083 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-96fb04c1-9e48-4468-ac98-73099a5762ab tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:27.768315 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-96fb04c1-9e48-4468-ac98-73099a5762ab tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:27.776721 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-96fb04c1-9e48-4468-ac98-73099a5762ab tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:27.778276 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-96fb04c1-9e48-4468-ac98-73099a5762ab tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:27.779456 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-96fb04c1-9e48-4468-ac98-73099a5762ab tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827" status: 200 len: 1728 microversion: 2.20 time: 0.168861 Oct 28 09:53:27.780394 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 376/742] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:53:27 2022] GET /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827 => generated 1728 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:53:28.627263 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-c996ee42-99d4-41d1-af1d-996201a06a51 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2a650861-9147-4276-9874-a15a366de6a3"}} {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:53:28.629703 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-c996ee42-99d4-41d1-af1d-996201a06a51 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] [instance: ae78bc7d-2e36-42d6-bcef-686291983088] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:28.636443 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-c996ee42-99d4-41d1-af1d-996201a06a51 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:28.636926 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-c996ee42-99d4-41d1-af1d-996201a06a51 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:28.637982 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-c996ee42-99d4-41d1-af1d-996201a06a51 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:28.638674 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-c996ee42-99d4-41d1-af1d-996201a06a51 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:28.639128 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-c996ee42-99d4-41d1-af1d-996201a06a51 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:28.639543 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-c996ee42-99d4-41d1-af1d-996201a06a51 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:28.806797 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-84f0951f-527b-48ff-bcae-4cc9e2445417 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:28.807343 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-84f0951f-527b-48ff-bcae-4cc9e2445417 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 125194a5-e664-4ea8-ad7e-b0ae1b54e827] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:28.813989 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-84f0951f-527b-48ff-bcae-4cc9e2445417 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:28.814477 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-84f0951f-527b-48ff-bcae-4cc9e2445417 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:28.814912 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-84f0951f-527b-48ff-bcae-4cc9e2445417 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:28.815606 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-84f0951f-527b-48ff-bcae-4cc9e2445417 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:28.816083 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-84f0951f-527b-48ff-bcae-4cc9e2445417 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:28.816502 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-84f0951f-527b-48ff-bcae-4cc9e2445417 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:28.957910 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-84f0951f-527b-48ff-bcae-4cc9e2445417 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:28.966510 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-84f0951f-527b-48ff-bcae-4cc9e2445417 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:28.967952 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-84f0951f-527b-48ff-bcae-4cc9e2445417 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:28.969108 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-84f0951f-527b-48ff-bcae-4cc9e2445417 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827" status: 200 len: 1728 microversion: 2.20 time: 0.166822 Oct 28 09:53:28.969671 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 377/743] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:53:28 2022] GET /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827 => generated 1728 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:53:29.994374 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-0adebd1e-7358-4b44-ae0d-5180839a8da8 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:29.995134 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-0adebd1e-7358-4b44-ae0d-5180839a8da8 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 125194a5-e664-4ea8-ad7e-b0ae1b54e827] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:30.003558 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-0adebd1e-7358-4b44-ae0d-5180839a8da8 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:30.004088 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-0adebd1e-7358-4b44-ae0d-5180839a8da8 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:30.004529 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-0adebd1e-7358-4b44-ae0d-5180839a8da8 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:30.005266 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-0adebd1e-7358-4b44-ae0d-5180839a8da8 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:30.005722 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-0adebd1e-7358-4b44-ae0d-5180839a8da8 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:30.006214 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-0adebd1e-7358-4b44-ae0d-5180839a8da8 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:30.149099 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-0adebd1e-7358-4b44-ae0d-5180839a8da8 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:30.157501 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-0adebd1e-7358-4b44-ae0d-5180839a8da8 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:30.158875 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-0adebd1e-7358-4b44-ae0d-5180839a8da8 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:30.160072 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-0adebd1e-7358-4b44-ae0d-5180839a8da8 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827" status: 200 len: 1728 microversion: 2.20 time: 0.169951 Oct 28 09:53:30.160825 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 378/744] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:53:29 2022] GET /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827 => generated 1728 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:53:31.185629 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-acab359a-75ca-4e7b-96f3-15057e7a6b26 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:31.186408 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-acab359a-75ca-4e7b-96f3-15057e7a6b26 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 125194a5-e664-4ea8-ad7e-b0ae1b54e827] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:31.192730 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-acab359a-75ca-4e7b-96f3-15057e7a6b26 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:31.193217 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-acab359a-75ca-4e7b-96f3-15057e7a6b26 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:31.193651 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-acab359a-75ca-4e7b-96f3-15057e7a6b26 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:31.194367 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-acab359a-75ca-4e7b-96f3-15057e7a6b26 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:31.194842 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-acab359a-75ca-4e7b-96f3-15057e7a6b26 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:31.195272 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-acab359a-75ca-4e7b-96f3-15057e7a6b26 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:31.331055 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-acab359a-75ca-4e7b-96f3-15057e7a6b26 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:31.340433 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-acab359a-75ca-4e7b-96f3-15057e7a6b26 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:31.342633 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-acab359a-75ca-4e7b-96f3-15057e7a6b26 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:31.343829 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-acab359a-75ca-4e7b-96f3-15057e7a6b26 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827" status: 200 len: 1728 microversion: 2.20 time: 0.162228 Oct 28 09:53:31.344391 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 379/745] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:53:31 2022] GET /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827 => generated 1728 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:53:32.368972 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-34befc5c-e76f-4c4e-b7a7-0c0024697418 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:32.369732 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-34befc5c-e76f-4c4e-b7a7-0c0024697418 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 125194a5-e664-4ea8-ad7e-b0ae1b54e827] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:32.375900 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-34befc5c-e76f-4c4e-b7a7-0c0024697418 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:32.376379 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-34befc5c-e76f-4c4e-b7a7-0c0024697418 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:32.376801 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-34befc5c-e76f-4c4e-b7a7-0c0024697418 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:32.377504 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-34befc5c-e76f-4c4e-b7a7-0c0024697418 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:32.377927 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-34befc5c-e76f-4c4e-b7a7-0c0024697418 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:32.378340 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-34befc5c-e76f-4c4e-b7a7-0c0024697418 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:32.512169 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-34befc5c-e76f-4c4e-b7a7-0c0024697418 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:32.520264 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-34befc5c-e76f-4c4e-b7a7-0c0024697418 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:32.521713 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-34befc5c-e76f-4c4e-b7a7-0c0024697418 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:32.522882 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-34befc5c-e76f-4c4e-b7a7-0c0024697418 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827" status: 200 len: 1728 microversion: 2.20 time: 0.158157 Oct 28 09:53:32.523448 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 380/746] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:53:32 2022] GET /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827 => generated 1728 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:53:33.548515 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-9d4b7a6c-2f80-4cb8-8b6a-144e70af4fa5 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:33.549210 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-9d4b7a6c-2f80-4cb8-8b6a-144e70af4fa5 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 125194a5-e664-4ea8-ad7e-b0ae1b54e827] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:33.555440 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-9d4b7a6c-2f80-4cb8-8b6a-144e70af4fa5 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:33.555966 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-9d4b7a6c-2f80-4cb8-8b6a-144e70af4fa5 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:33.556402 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-9d4b7a6c-2f80-4cb8-8b6a-144e70af4fa5 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:33.557092 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-9d4b7a6c-2f80-4cb8-8b6a-144e70af4fa5 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:33.557549 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-9d4b7a6c-2f80-4cb8-8b6a-144e70af4fa5 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:33.557969 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-9d4b7a6c-2f80-4cb8-8b6a-144e70af4fa5 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:33.686967 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-9d4b7a6c-2f80-4cb8-8b6a-144e70af4fa5 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:33.695183 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-9d4b7a6c-2f80-4cb8-8b6a-144e70af4fa5 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:33.696660 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-9d4b7a6c-2f80-4cb8-8b6a-144e70af4fa5 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:33.697820 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-9d4b7a6c-2f80-4cb8-8b6a-144e70af4fa5 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827" status: 200 len: 1728 microversion: 2.20 time: 0.153195 Oct 28 09:53:33.698380 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 381/747] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:53:33 2022] GET /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827 => generated 1728 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:53:34.722855 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-6449a8ab-cb14-416a-9581-4c6dd439797b tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:34.723544 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-6449a8ab-cb14-416a-9581-4c6dd439797b tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 125194a5-e664-4ea8-ad7e-b0ae1b54e827] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:34.729944 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-6449a8ab-cb14-416a-9581-4c6dd439797b tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:34.730429 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-6449a8ab-cb14-416a-9581-4c6dd439797b tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:34.730865 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-6449a8ab-cb14-416a-9581-4c6dd439797b tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:34.732136 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-6449a8ab-cb14-416a-9581-4c6dd439797b tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:34.732605 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-6449a8ab-cb14-416a-9581-4c6dd439797b tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:34.733021 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-6449a8ab-cb14-416a-9581-4c6dd439797b tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:34.862536 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-6449a8ab-cb14-416a-9581-4c6dd439797b tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:34.871227 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-6449a8ab-cb14-416a-9581-4c6dd439797b tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:34.873252 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-6449a8ab-cb14-416a-9581-4c6dd439797b tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:34.874420 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-6449a8ab-cb14-416a-9581-4c6dd439797b tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827" status: 200 len: 1728 microversion: 2.20 time: 0.155616 Oct 28 09:53:34.874987 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 382/748] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:53:34 2022] GET /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827 => generated 1728 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:53:35.268001 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG dbcounter [-] [127033] Writing DB stats nova_cell1:SELECT=88,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=127033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:53:35.382668 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-c996ee42-99d4-41d1-af1d-996201a06a51 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] 10.222.0.52 "POST /compute/v2.1/servers/ae78bc7d-2e36-42d6-bcef-686291983088/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 6.759207 Oct 28 09:53:35.383347 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 367/749] 10.222.0.52 () {60 vars in 1323 bytes} [Fri Oct 28 09:53:28 2022] POST /compute/v2.1/servers/ae78bc7d-2e36-42d6-bcef-686291983088/os-volume_attachments => generated 194 bytes in 6761 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:53:35.899654 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-721a23f6-f41e-4d3d-833a-a23b71e517d3 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:35.900289 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-721a23f6-f41e-4d3d-833a-a23b71e517d3 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 125194a5-e664-4ea8-ad7e-b0ae1b54e827] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:35.906559 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-721a23f6-f41e-4d3d-833a-a23b71e517d3 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:35.907036 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-721a23f6-f41e-4d3d-833a-a23b71e517d3 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:35.907463 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-721a23f6-f41e-4d3d-833a-a23b71e517d3 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:35.908173 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-721a23f6-f41e-4d3d-833a-a23b71e517d3 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:35.908620 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-721a23f6-f41e-4d3d-833a-a23b71e517d3 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:35.909036 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-721a23f6-f41e-4d3d-833a-a23b71e517d3 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:36.042262 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-721a23f6-f41e-4d3d-833a-a23b71e517d3 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:36.050373 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-721a23f6-f41e-4d3d-833a-a23b71e517d3 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:36.051826 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-721a23f6-f41e-4d3d-833a-a23b71e517d3 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:36.052988 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-721a23f6-f41e-4d3d-833a-a23b71e517d3 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827" status: 200 len: 1728 microversion: 2.20 time: 0.157339 Oct 28 09:53:36.053545 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 383/750] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:53:35 2022] GET /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827 => generated 1728 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:53:37.080210 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-41dfe68b-c747-4346-a3df-319541307ad1 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:37.080803 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-41dfe68b-c747-4346-a3df-319541307ad1 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 125194a5-e664-4ea8-ad7e-b0ae1b54e827] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:37.087606 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-41dfe68b-c747-4346-a3df-319541307ad1 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:37.088115 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-41dfe68b-c747-4346-a3df-319541307ad1 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:37.088557 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-41dfe68b-c747-4346-a3df-319541307ad1 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:37.089261 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-41dfe68b-c747-4346-a3df-319541307ad1 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:37.089722 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-41dfe68b-c747-4346-a3df-319541307ad1 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:37.090141 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-41dfe68b-c747-4346-a3df-319541307ad1 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:37.218468 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-41dfe68b-c747-4346-a3df-319541307ad1 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:37.226850 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-41dfe68b-c747-4346-a3df-319541307ad1 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:37.228334 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-41dfe68b-c747-4346-a3df-319541307ad1 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:37.229492 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-41dfe68b-c747-4346-a3df-319541307ad1 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827" status: 200 len: 1728 microversion: 2.20 time: 0.154675 Oct 28 09:53:37.230058 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 368/751] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:53:37 2022] GET /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827 => generated 1728 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:53:38.255656 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-5ad24ab8-835c-41f7-8764-90edb3567210 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:38.256348 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-5ad24ab8-835c-41f7-8764-90edb3567210 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 125194a5-e664-4ea8-ad7e-b0ae1b54e827] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:38.263165 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-5ad24ab8-835c-41f7-8764-90edb3567210 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:38.263837 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-5ad24ab8-835c-41f7-8764-90edb3567210 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:38.264428 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-5ad24ab8-835c-41f7-8764-90edb3567210 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:38.265414 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-5ad24ab8-835c-41f7-8764-90edb3567210 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:38.265951 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-5ad24ab8-835c-41f7-8764-90edb3567210 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:38.266374 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-5ad24ab8-835c-41f7-8764-90edb3567210 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:38.411033 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-5ad24ab8-835c-41f7-8764-90edb3567210 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:38.420075 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-5ad24ab8-835c-41f7-8764-90edb3567210 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:38.421627 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-5ad24ab8-835c-41f7-8764-90edb3567210 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:38.422779 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-5ad24ab8-835c-41f7-8764-90edb3567210 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827" status: 200 len: 1728 microversion: 2.20 time: 0.171159 Oct 28 09:53:38.423378 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 384/752] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:53:38 2022] GET /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827 => generated 1728 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:53:39.449418 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-a27e6661-948a-444a-8adc-bf6a610669c0 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:39.450332 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-a27e6661-948a-444a-8adc-bf6a610669c0 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 125194a5-e664-4ea8-ad7e-b0ae1b54e827] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:39.457980 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-a27e6661-948a-444a-8adc-bf6a610669c0 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:39.459045 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-a27e6661-948a-444a-8adc-bf6a610669c0 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:39.459493 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-a27e6661-948a-444a-8adc-bf6a610669c0 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:39.461014 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-a27e6661-948a-444a-8adc-bf6a610669c0 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:39.461510 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-a27e6661-948a-444a-8adc-bf6a610669c0 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:39.461934 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-a27e6661-948a-444a-8adc-bf6a610669c0 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:39.600701 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-a27e6661-948a-444a-8adc-bf6a610669c0 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:39.609193 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-a27e6661-948a-444a-8adc-bf6a610669c0 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:39.610606 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-a27e6661-948a-444a-8adc-bf6a610669c0 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:39.611767 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-a27e6661-948a-444a-8adc-bf6a610669c0 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827" status: 200 len: 1728 microversion: 2.20 time: 0.166594 Oct 28 09:53:39.612329 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 369/753] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:53:39 2022] GET /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827 => generated 1728 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:53:39.739341 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-bbc4bb36-75e4-4ef5-b772-fc18119e72a4 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:39.741881 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-bbc4bb36-75e4-4ef5-b772-fc18119e72a4 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] [instance: ae78bc7d-2e36-42d6-bcef-686291983088] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:39.748466 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-bbc4bb36-75e4-4ef5-b772-fc18119e72a4 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:39.748944 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-bbc4bb36-75e4-4ef5-b772-fc18119e72a4 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:39.749380 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-bbc4bb36-75e4-4ef5-b772-fc18119e72a4 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:39.750067 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-bbc4bb36-75e4-4ef5-b772-fc18119e72a4 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:39.750513 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-bbc4bb36-75e4-4ef5-b772-fc18119e72a4 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:39.750928 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-bbc4bb36-75e4-4ef5-b772-fc18119e72a4 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:39.782795 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-bbc4bb36-75e4-4ef5-b772-fc18119e72a4 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] 10.222.0.52 "GET /compute/v2.1/servers/ae78bc7d-2e36-42d6-bcef-686291983088/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047449 Oct 28 09:53:39.783713 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 385/754] 10.222.0.52 () {58 vars in 1302 bytes} [Fri Oct 28 09:53:39 2022] GET /compute/v2.1/servers/ae78bc7d-2e36-42d6-bcef-686291983088/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:53:39.795506 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-10cd457f-6bfc-4a6c-ad45-1cedd007d971 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:39.796336 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-10cd457f-6bfc-4a6c-ad45-1cedd007d971 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] [instance: ae78bc7d-2e36-42d6-bcef-686291983088] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:39.803786 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-10cd457f-6bfc-4a6c-ad45-1cedd007d971 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:39.804291 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-10cd457f-6bfc-4a6c-ad45-1cedd007d971 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:39.804732 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-10cd457f-6bfc-4a6c-ad45-1cedd007d971 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:39.805437 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-10cd457f-6bfc-4a6c-ad45-1cedd007d971 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:39.805910 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-10cd457f-6bfc-4a6c-ad45-1cedd007d971 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:39.806313 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-10cd457f-6bfc-4a6c-ad45-1cedd007d971 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:39.837740 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-10cd457f-6bfc-4a6c-ad45-1cedd007d971 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] 10.222.0.52 "GET /compute/v2.1/servers/ae78bc7d-2e36-42d6-bcef-686291983088/os-volume_attachments/2a650861-9147-4276-9874-a15a366de6a3" status: 200 len: 194 microversion: 2.1 time: 0.047222 Oct 28 09:53:39.838338 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 370/755] 10.222.0.52 () {58 vars in 1413 bytes} [Fri Oct 28 09:53:39 2022] GET /compute/v2.1/servers/ae78bc7d-2e36-42d6-bcef-686291983088/os-volume_attachments/2a650861-9147-4276-9874-a15a366de6a3 => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:53:40.537806 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [req-aa96c345-c14a-49f1-a41c-308c2d516b1f req-13e66203-bc7f-4775-9416-ac9490f88753 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "125194a5-e664-4ea8-ad7e-b0ae1b54e827", "name": "network-vif-plugged", "status": "completed", "tag": "ff843068-026c-460b-ae99-a8c3ca1fb539"}]} {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:53:40.550541 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-aa96c345-c14a-49f1-a41c-308c2d516b1f req-13e66203-bc7f-4775-9416-ac9490f88753 service nova] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:40.551122 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-aa96c345-c14a-49f1-a41c-308c2d516b1f req-13e66203-bc7f-4775-9416-ac9490f88753 service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:40.551826 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-aa96c345-c14a-49f1-a41c-308c2d516b1f req-13e66203-bc7f-4775-9416-ac9490f88753 service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:40.563884 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.compute.server_external_events [req-aa96c345-c14a-49f1-a41c-308c2d516b1f req-13e66203-bc7f-4775-9416-ac9490f88753 service nova] Creating event network-vif-plugged:ff843068-026c-460b-ae99-a8c3ca1fb539 for instance 125194a5-e664-4ea8-ad7e-b0ae1b54e827 on hv-cinder-zed-3 Oct 28 09:53:40.569137 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [req-aa96c345-c14a-49f1-a41c-308c2d516b1f req-13e66203-bc7f-4775-9416-ac9490f88753 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035009 Oct 28 09:53:40.570132 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 386/756] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Oct 28 09:53:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:53:40.638366 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-49ed6c40-141a-4001-b703-94f9d0d67e52 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:40.639577 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-49ed6c40-141a-4001-b703-94f9d0d67e52 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 125194a5-e664-4ea8-ad7e-b0ae1b54e827] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:40.642083 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG dbcounter [-] [127033] Writing DB stats nova_api:SELECT=30 {{(pid=127033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:53:40.647475 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-49ed6c40-141a-4001-b703-94f9d0d67e52 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:40.648025 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-49ed6c40-141a-4001-b703-94f9d0d67e52 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:40.648525 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-49ed6c40-141a-4001-b703-94f9d0d67e52 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:40.649163 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-49ed6c40-141a-4001-b703-94f9d0d67e52 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:40.649619 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-49ed6c40-141a-4001-b703-94f9d0d67e52 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:40.650044 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-49ed6c40-141a-4001-b703-94f9d0d67e52 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:40.816466 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-49ed6c40-141a-4001-b703-94f9d0d67e52 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:40.825173 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-49ed6c40-141a-4001-b703-94f9d0d67e52 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:40.827204 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-49ed6c40-141a-4001-b703-94f9d0d67e52 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:40.828570 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-49ed6c40-141a-4001-b703-94f9d0d67e52 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827" status: 200 len: 1728 microversion: 2.20 time: 0.194680 Oct 28 09:53:40.829148 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 371/757] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:53:40 2022] GET /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827 => generated 1728 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:53:41.187520 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-e6be9938-d95a-49df-8f5b-4c52c97491ed tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b404c0bd-cfff-47d5-81bf-04f638e41321"}} {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:53:41.189981 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-e6be9938-d95a-49df-8f5b-4c52c97491ed tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] [instance: ae78bc7d-2e36-42d6-bcef-686291983088] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:41.191911 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG dbcounter [-] [127032] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1 {{(pid=127032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:53:41.197233 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-e6be9938-d95a-49df-8f5b-4c52c97491ed tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:41.197711 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-e6be9938-d95a-49df-8f5b-4c52c97491ed tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:41.198141 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-e6be9938-d95a-49df-8f5b-4c52c97491ed tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:41.198826 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-e6be9938-d95a-49df-8f5b-4c52c97491ed tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:41.199275 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-e6be9938-d95a-49df-8f5b-4c52c97491ed tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:41.199692 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-e6be9938-d95a-49df-8f5b-4c52c97491ed tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:41.854232 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-c2d8d404-8136-4b97-8ae9-915caab23ee5 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:41.854871 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-c2d8d404-8136-4b97-8ae9-915caab23ee5 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 125194a5-e664-4ea8-ad7e-b0ae1b54e827] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:41.862106 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-c2d8d404-8136-4b97-8ae9-915caab23ee5 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:41.862589 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-c2d8d404-8136-4b97-8ae9-915caab23ee5 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:41.863013 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-c2d8d404-8136-4b97-8ae9-915caab23ee5 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:41.863699 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-c2d8d404-8136-4b97-8ae9-915caab23ee5 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:41.864171 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-c2d8d404-8136-4b97-8ae9-915caab23ee5 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:41.864732 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-c2d8d404-8136-4b97-8ae9-915caab23ee5 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:41.956186 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-e6be9938-d95a-49df-8f5b-4c52c97491ed tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] 10.222.0.52 "POST /compute/v2.1/servers/ae78bc7d-2e36-42d6-bcef-686291983088/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.773277 Oct 28 09:53:41.957237 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 387/758] 10.222.0.52 () {60 vars in 1323 bytes} [Fri Oct 28 09:53:41 2022] POST /compute/v2.1/servers/ae78bc7d-2e36-42d6-bcef-686291983088/os-volume_attachments => generated 194 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:53:42.006252 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-c2d8d404-8136-4b97-8ae9-915caab23ee5 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:42.014735 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-c2d8d404-8136-4b97-8ae9-915caab23ee5 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:42.016247 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-c2d8d404-8136-4b97-8ae9-915caab23ee5 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:42.017428 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-c2d8d404-8136-4b97-8ae9-915caab23ee5 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827" status: 200 len: 1728 microversion: 2.20 time: 0.167069 Oct 28 09:53:42.017980 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 372/759] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:53:41 2022] GET /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827 => generated 1728 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:53:43.043044 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-176f0051-7975-4a27-98ef-f14e74564e92 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:43.043785 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-176f0051-7975-4a27-98ef-f14e74564e92 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 125194a5-e664-4ea8-ad7e-b0ae1b54e827] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:43.051174 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-176f0051-7975-4a27-98ef-f14e74564e92 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:43.051735 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-176f0051-7975-4a27-98ef-f14e74564e92 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:43.052124 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-176f0051-7975-4a27-98ef-f14e74564e92 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:43.052832 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-176f0051-7975-4a27-98ef-f14e74564e92 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:43.053286 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-176f0051-7975-4a27-98ef-f14e74564e92 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:43.053709 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-176f0051-7975-4a27-98ef-f14e74564e92 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:43.184519 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-176f0051-7975-4a27-98ef-f14e74564e92 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:43.193510 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-176f0051-7975-4a27-98ef-f14e74564e92 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:43.194950 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-176f0051-7975-4a27-98ef-f14e74564e92 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:43.196133 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-176f0051-7975-4a27-98ef-f14e74564e92 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827" status: 200 len: 1728 microversion: 2.20 time: 0.157462 Oct 28 09:53:43.196692 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 388/760] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:53:43 2022] GET /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827 => generated 1728 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:53:44.221721 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-955102da-3ee1-4d66-88fe-5def55ae309b tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:44.222328 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-955102da-3ee1-4d66-88fe-5def55ae309b tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 125194a5-e664-4ea8-ad7e-b0ae1b54e827] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:44.228751 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-955102da-3ee1-4d66-88fe-5def55ae309b tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:44.229231 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-955102da-3ee1-4d66-88fe-5def55ae309b tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:44.229664 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-955102da-3ee1-4d66-88fe-5def55ae309b tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:44.230354 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-955102da-3ee1-4d66-88fe-5def55ae309b tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:44.230811 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-955102da-3ee1-4d66-88fe-5def55ae309b tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:44.231235 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-955102da-3ee1-4d66-88fe-5def55ae309b tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:44.367044 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-955102da-3ee1-4d66-88fe-5def55ae309b tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:44.375061 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-955102da-3ee1-4d66-88fe-5def55ae309b tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:44.376597 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-955102da-3ee1-4d66-88fe-5def55ae309b tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:44.377751 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-955102da-3ee1-4d66-88fe-5def55ae309b tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827" status: 200 len: 1715 microversion: 2.20 time: 0.160024 Oct 28 09:53:44.378303 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 373/761] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:53:44 2022] GET /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827 => generated 1715 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:53:45.267096 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-114c44de-0209-4e14-b74e-b9cfa66853a6 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:45.269346 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-114c44de-0209-4e14-b74e-b9cfa66853a6 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] [instance: ae78bc7d-2e36-42d6-bcef-686291983088] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:45.275688 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-114c44de-0209-4e14-b74e-b9cfa66853a6 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:45.276196 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-114c44de-0209-4e14-b74e-b9cfa66853a6 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:45.276628 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-114c44de-0209-4e14-b74e-b9cfa66853a6 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:45.277311 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-114c44de-0209-4e14-b74e-b9cfa66853a6 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:45.277761 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-114c44de-0209-4e14-b74e-b9cfa66853a6 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:45.278176 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-114c44de-0209-4e14-b74e-b9cfa66853a6 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:45.308067 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-114c44de-0209-4e14-b74e-b9cfa66853a6 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] 10.222.0.52 "GET /compute/v2.1/servers/ae78bc7d-2e36-42d6-bcef-686291983088/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045321 Oct 28 09:53:45.308620 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 389/762] 10.222.0.52 () {58 vars in 1302 bytes} [Fri Oct 28 09:53:45 2022] GET /compute/v2.1/servers/ae78bc7d-2e36-42d6-bcef-686291983088/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:53:45.446882 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-16dea001-93c2-4699-a125-535fbc2c1a1e tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:45.447442 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-16dea001-93c2-4699-a125-535fbc2c1a1e tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] [instance: ae78bc7d-2e36-42d6-bcef-686291983088] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:45.454648 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-16dea001-93c2-4699-a125-535fbc2c1a1e tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:45.455142 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-16dea001-93c2-4699-a125-535fbc2c1a1e tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:45.455578 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-16dea001-93c2-4699-a125-535fbc2c1a1e tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:45.456316 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-16dea001-93c2-4699-a125-535fbc2c1a1e tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:45.456787 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-16dea001-93c2-4699-a125-535fbc2c1a1e tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:45.457196 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-16dea001-93c2-4699-a125-535fbc2c1a1e tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:45.487821 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-16dea001-93c2-4699-a125-535fbc2c1a1e tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] 10.222.0.52 "GET /compute/v2.1/servers/ae78bc7d-2e36-42d6-bcef-686291983088/os-volume_attachments/2a650861-9147-4276-9874-a15a366de6a3" status: 200 len: 194 microversion: 2.1 time: 0.044845 Oct 28 09:53:45.488429 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 374/763] 10.222.0.52 () {58 vars in 1413 bytes} [Fri Oct 28 09:53:45 2022] GET /compute/v2.1/servers/ae78bc7d-2e36-42d6-bcef-686291983088/os-volume_attachments/2a650861-9147-4276-9874-a15a366de6a3 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:53:45.499054 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-e78bb21b-ec12-4b4a-90c6-8e3a4402a8be tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:45.499542 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-e78bb21b-ec12-4b4a-90c6-8e3a4402a8be tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] [instance: ae78bc7d-2e36-42d6-bcef-686291983088] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:45.505579 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-e78bb21b-ec12-4b4a-90c6-8e3a4402a8be tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:45.506094 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-e78bb21b-ec12-4b4a-90c6-8e3a4402a8be tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:45.506531 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-e78bb21b-ec12-4b4a-90c6-8e3a4402a8be tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:45.507230 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-e78bb21b-ec12-4b4a-90c6-8e3a4402a8be tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:45.507696 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-e78bb21b-ec12-4b4a-90c6-8e3a4402a8be tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:45.508152 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-e78bb21b-ec12-4b4a-90c6-8e3a4402a8be tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:45.587721 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.objects.instance [None req-e78bb21b-ec12-4b4a-90c6-8e3a4402a8be tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lazy-loading 'services' on Instance uuid ae78bc7d-2e36-42d6-bcef-686291983088 {{(pid=127032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:53:45.591075 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG dbcounter [-] [127032] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:53:45.662916 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-e78bb21b-ec12-4b4a-90c6-8e3a4402a8be tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] 10.222.0.52 "DELETE /compute/v2.1/servers/ae78bc7d-2e36-42d6-bcef-686291983088/os-volume_attachments/2a650861-9147-4276-9874-a15a366de6a3" status: 202 len: 0 microversion: 2.1 time: 0.167613 Oct 28 09:53:45.663517 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 390/764] 10.222.0.52 () {58 vars in 1416 bytes} [Fri Oct 28 09:53:45 2022] DELETE /compute/v2.1/servers/ae78bc7d-2e36-42d6-bcef-686291983088/os-volume_attachments/2a650861-9147-4276-9874-a15a366de6a3 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:53:47.842153 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-edfbc5a9-7684-43ba-8281-055fdbf65c90 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:47.842676 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-edfbc5a9-7684-43ba-8281-055fdbf65c90 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] [instance: ae78bc7d-2e36-42d6-bcef-686291983088] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:47.849034 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-edfbc5a9-7684-43ba-8281-055fdbf65c90 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:47.849520 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-edfbc5a9-7684-43ba-8281-055fdbf65c90 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:47.849962 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-edfbc5a9-7684-43ba-8281-055fdbf65c90 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:47.850648 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-edfbc5a9-7684-43ba-8281-055fdbf65c90 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:47.851106 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-edfbc5a9-7684-43ba-8281-055fdbf65c90 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:47.851535 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-edfbc5a9-7684-43ba-8281-055fdbf65c90 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:47.880423 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-edfbc5a9-7684-43ba-8281-055fdbf65c90 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] 10.222.0.52 "GET /compute/v2.1/servers/ae78bc7d-2e36-42d6-bcef-686291983088/os-volume_attachments/b404c0bd-cfff-47d5-81bf-04f638e41321" status: 200 len: 194 microversion: 2.1 time: 0.042300 Oct 28 09:53:47.881011 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 375/765] 10.222.0.52 () {58 vars in 1413 bytes} [Fri Oct 28 09:53:47 2022] GET /compute/v2.1/servers/ae78bc7d-2e36-42d6-bcef-686291983088/os-volume_attachments/b404c0bd-cfff-47d5-81bf-04f638e41321 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:53:47.893214 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-13f20e0b-dc31-42b7-a7c0-6973cd0dae30 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:47.893797 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-13f20e0b-dc31-42b7-a7c0-6973cd0dae30 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] [instance: ae78bc7d-2e36-42d6-bcef-686291983088] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:47.899902 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-13f20e0b-dc31-42b7-a7c0-6973cd0dae30 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:47.900389 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-13f20e0b-dc31-42b7-a7c0-6973cd0dae30 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:47.900825 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-13f20e0b-dc31-42b7-a7c0-6973cd0dae30 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:47.901514 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-13f20e0b-dc31-42b7-a7c0-6973cd0dae30 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:47.901969 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-13f20e0b-dc31-42b7-a7c0-6973cd0dae30 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:47.902424 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-13f20e0b-dc31-42b7-a7c0-6973cd0dae30 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:47.982327 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.objects.instance [None req-13f20e0b-dc31-42b7-a7c0-6973cd0dae30 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lazy-loading 'services' on Instance uuid ae78bc7d-2e36-42d6-bcef-686291983088 {{(pid=127032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:53:48.053022 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-13f20e0b-dc31-42b7-a7c0-6973cd0dae30 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] 10.222.0.52 "DELETE /compute/v2.1/servers/ae78bc7d-2e36-42d6-bcef-686291983088/os-volume_attachments/b404c0bd-cfff-47d5-81bf-04f638e41321" status: 202 len: 0 microversion: 2.1 time: 0.165035 Oct 28 09:53:48.053659 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 391/766] 10.222.0.52 () {58 vars in 1416 bytes} [Fri Oct 28 09:53:47 2022] DELETE /compute/v2.1/servers/ae78bc7d-2e36-42d6-bcef-686291983088/os-volume_attachments/b404c0bd-cfff-47d5-81bf-04f638e41321 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:53:49.252542 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-f205ed25-0a36-4b05-81a6-a93b76f5b0f7 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:49.254953 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-f205ed25-0a36-4b05-81a6-a93b76f5b0f7 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] [instance: ae78bc7d-2e36-42d6-bcef-686291983088] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:49.262235 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-f205ed25-0a36-4b05-81a6-a93b76f5b0f7 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:49.262734 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-f205ed25-0a36-4b05-81a6-a93b76f5b0f7 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:49.263175 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-f205ed25-0a36-4b05-81a6-a93b76f5b0f7 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:49.264520 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-f205ed25-0a36-4b05-81a6-a93b76f5b0f7 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:49.264989 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-f205ed25-0a36-4b05-81a6-a93b76f5b0f7 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:49.265423 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-f205ed25-0a36-4b05-81a6-a93b76f5b0f7 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:49.296916 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-f205ed25-0a36-4b05-81a6-a93b76f5b0f7 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] 10.222.0.52 "GET /compute/v2.1/servers/ae78bc7d-2e36-42d6-bcef-686291983088/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048896 Oct 28 09:53:49.297400 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 376/767] 10.222.0.52 () {58 vars in 1302 bytes} [Fri Oct 28 09:53:49 2022] GET /compute/v2.1/servers/ae78bc7d-2e36-42d6-bcef-686291983088/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 09:53:49.417360 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-bde39207-1e64-4a4e-b3a4-9ec238beaee0 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:49.419661 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-bde39207-1e64-4a4e-b3a4-9ec238beaee0 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] [instance: ae78bc7d-2e36-42d6-bcef-686291983088] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:49.425986 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-bde39207-1e64-4a4e-b3a4-9ec238beaee0 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:49.426467 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-bde39207-1e64-4a4e-b3a4-9ec238beaee0 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:49.426899 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-bde39207-1e64-4a4e-b3a4-9ec238beaee0 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:49.427589 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-bde39207-1e64-4a4e-b3a4-9ec238beaee0 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:49.428069 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-bde39207-1e64-4a4e-b3a4-9ec238beaee0 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:49.428489 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-bde39207-1e64-4a4e-b3a4-9ec238beaee0 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:49.461565 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-bde39207-1e64-4a4e-b3a4-9ec238beaee0 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] 10.222.0.52 "GET /compute/v2.1/servers/ae78bc7d-2e36-42d6-bcef-686291983088/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048980 Oct 28 09:53:49.462310 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 392/768] 10.222.0.52 () {58 vars in 1302 bytes} [Fri Oct 28 09:53:49 2022] GET /compute/v2.1/servers/ae78bc7d-2e36-42d6-bcef-686291983088/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 09:53:49.532158 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-737f5cc1-8bb1-42b4-bf2b-6187c31bc875 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:49.532648 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-737f5cc1-8bb1-42b4-bf2b-6187c31bc875 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] [instance: ae78bc7d-2e36-42d6-bcef-686291983088] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:49.538708 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-737f5cc1-8bb1-42b4-bf2b-6187c31bc875 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:49.539193 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-737f5cc1-8bb1-42b4-bf2b-6187c31bc875 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:49.539623 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-737f5cc1-8bb1-42b4-bf2b-6187c31bc875 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:49.540505 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-737f5cc1-8bb1-42b4-bf2b-6187c31bc875 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:49.540959 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-737f5cc1-8bb1-42b4-bf2b-6187c31bc875 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:49.541382 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-737f5cc1-8bb1-42b4-bf2b-6187c31bc875 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:49.568216 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-737f5cc1-8bb1-42b4-bf2b-6187c31bc875 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] [instance: ae78bc7d-2e36-42d6-bcef-686291983088] Going to try to terminate instance {{(pid=127033) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 09:53:49.651683 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-737f5cc1-8bb1-42b4-bf2b-6187c31bc875 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] 10.222.0.52 "DELETE /compute/v2.1/servers/ae78bc7d-2e36-42d6-bcef-686291983088" status: 204 len: 0 microversion: 2.1 time: 0.123605 Oct 28 09:53:49.653757 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 377/769] 10.222.0.52 () {58 vars in 1239 bytes} [Fri Oct 28 09:53:49 2022] DELETE /compute/v2.1/servers/ae78bc7d-2e36-42d6-bcef-686291983088 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 09:53:49.663170 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-ae20ea5f-49f7-4a7b-bb59-4de831bb7704 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:49.663836 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-ae20ea5f-49f7-4a7b-bb59-4de831bb7704 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] [instance: ae78bc7d-2e36-42d6-bcef-686291983088] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:49.669788 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ae20ea5f-49f7-4a7b-bb59-4de831bb7704 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:49.670282 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ae20ea5f-49f7-4a7b-bb59-4de831bb7704 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:49.670718 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ae20ea5f-49f7-4a7b-bb59-4de831bb7704 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:49.671419 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ae20ea5f-49f7-4a7b-bb59-4de831bb7704 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:49.671989 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ae20ea5f-49f7-4a7b-bb59-4de831bb7704 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:49.672335 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ae20ea5f-49f7-4a7b-bb59-4de831bb7704 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:49.810134 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-ae20ea5f-49f7-4a7b-bb59-4de831bb7704 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bee2d5f599642788c32e0d8b8338c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e7d531c0f4a33a869309af965e3e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:49.818027 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-ae20ea5f-49f7-4a7b-bb59-4de831bb7704 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] 10.222.0.52 "GET /compute/v2.1/servers/ae78bc7d-2e36-42d6-bcef-686291983088" status: 200 len: 1672 microversion: 2.1 time: 0.158756 Oct 28 09:53:49.818671 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 393/770] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:53:49 2022] GET /compute/v2.1/servers/ae78bc7d-2e36-42d6-bcef-686291983088 => generated 1672 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:50.842364 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-99d32d55-31f9-4f8b-94e6-f083051696a0 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:50.843073 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-99d32d55-31f9-4f8b-94e6-f083051696a0 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] [instance: ae78bc7d-2e36-42d6-bcef-686291983088] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:50.849669 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-99d32d55-31f9-4f8b-94e6-f083051696a0 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:50.850160 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-99d32d55-31f9-4f8b-94e6-f083051696a0 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:50.850595 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-99d32d55-31f9-4f8b-94e6-f083051696a0 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:50.851296 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-99d32d55-31f9-4f8b-94e6-f083051696a0 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:50.851773 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-99d32d55-31f9-4f8b-94e6-f083051696a0 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:50.852208 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-99d32d55-31f9-4f8b-94e6-f083051696a0 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:50.997757 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-99d32d55-31f9-4f8b-94e6-f083051696a0 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bee2d5f599642788c32e0d8b8338c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e7d531c0f4a33a869309af965e3e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:51.006585 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-99d32d55-31f9-4f8b-94e6-f083051696a0 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] 10.222.0.52 "GET /compute/v2.1/servers/ae78bc7d-2e36-42d6-bcef-686291983088" status: 200 len: 1672 microversion: 2.1 time: 0.168419 Oct 28 09:53:51.007171 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 378/771] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:53:50 2022] GET /compute/v2.1/servers/ae78bc7d-2e36-42d6-bcef-686291983088 => generated 1672 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:52.031163 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-bed00ceb-a600-42c5-a625-effa4ca5c515 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:52.031980 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-bed00ceb-a600-42c5-a625-effa4ca5c515 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] [instance: ae78bc7d-2e36-42d6-bcef-686291983088] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:52.038680 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-bed00ceb-a600-42c5-a625-effa4ca5c515 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:52.039159 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-bed00ceb-a600-42c5-a625-effa4ca5c515 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:52.039589 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-bed00ceb-a600-42c5-a625-effa4ca5c515 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:52.040309 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-bed00ceb-a600-42c5-a625-effa4ca5c515 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:52.040756 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-bed00ceb-a600-42c5-a625-effa4ca5c515 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:52.041170 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-bed00ceb-a600-42c5-a625-effa4ca5c515 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:52.172119 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-bed00ceb-a600-42c5-a625-effa4ca5c515 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bee2d5f599642788c32e0d8b8338c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e7d531c0f4a33a869309af965e3e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:52.180007 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-bed00ceb-a600-42c5-a625-effa4ca5c515 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] 10.222.0.52 "GET /compute/v2.1/servers/ae78bc7d-2e36-42d6-bcef-686291983088" status: 200 len: 1672 microversion: 2.1 time: 0.152988 Oct 28 09:53:52.180514 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 394/772] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:53:52 2022] GET /compute/v2.1/servers/ae78bc7d-2e36-42d6-bcef-686291983088 => generated 1672 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:52.720225 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [req-41b8cbc2-9b3a-4c95-9dc6-bf5e1e7b268a req-47fa15aa-4a0d-4ab0-bb1f-3a68fc7460b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae78bc7d-2e36-42d6-bcef-686291983088", "name": "network-vif-deleted", "tag": "ae9bf3c2-16e5-43fd-adc5-89f48a0f6425"}]} {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:53:52.740177 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-41b8cbc2-9b3a-4c95-9dc6-bf5e1e7b268a req-47fa15aa-4a0d-4ab0-bb1f-3a68fc7460b9 service nova] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:52.741327 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-41b8cbc2-9b3a-4c95-9dc6-bf5e1e7b268a req-47fa15aa-4a0d-4ab0-bb1f-3a68fc7460b9 service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:52.741941 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-41b8cbc2-9b3a-4c95-9dc6-bf5e1e7b268a req-47fa15aa-4a0d-4ab0-bb1f-3a68fc7460b9 service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:52.756663 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.compute.server_external_events [req-41b8cbc2-9b3a-4c95-9dc6-bf5e1e7b268a req-47fa15aa-4a0d-4ab0-bb1f-3a68fc7460b9 service nova] Creating event network-vif-deleted:ae9bf3c2-16e5-43fd-adc5-89f48a0f6425 for instance ae78bc7d-2e36-42d6-bcef-686291983088 on hv-cinder-zed-3 Oct 28 09:53:52.763022 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [req-41b8cbc2-9b3a-4c95-9dc6-bf5e1e7b268a req-47fa15aa-4a0d-4ab0-bb1f-3a68fc7460b9 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050659 Oct 28 09:53:52.764556 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 379/773] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Oct 28 09:53:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:53:53.204684 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-2d40c297-1880-4ab0-a4b1-241e95fa0ca0 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:53.205342 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-2d40c297-1880-4ab0-a4b1-241e95fa0ca0 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] [instance: ae78bc7d-2e36-42d6-bcef-686291983088] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:53.211654 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-2d40c297-1880-4ab0-a4b1-241e95fa0ca0 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:53.212174 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-2d40c297-1880-4ab0-a4b1-241e95fa0ca0 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:53.212608 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-2d40c297-1880-4ab0-a4b1-241e95fa0ca0 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:53.213296 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-2d40c297-1880-4ab0-a4b1-241e95fa0ca0 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:53.213748 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-2d40c297-1880-4ab0-a4b1-241e95fa0ca0 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:53.214166 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-2d40c297-1880-4ab0-a4b1-241e95fa0ca0 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:53.245077 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-2d40c297-1880-4ab0-a4b1-241e95fa0ca0 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:53.245560 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-2d40c297-1880-4ab0-a4b1-241e95fa0ca0 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:53.245993 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-2d40c297-1880-4ab0-a4b1-241e95fa0ca0 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:53.246435 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.objects.instance [None req-2d40c297-1880-4ab0-a4b1-241e95fa0ca0 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lazy-loading 'fault' on Instance uuid ae78bc7d-2e36-42d6-bcef-686291983088 {{(pid=127032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:53:53.289107 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-2d40c297-1880-4ab0-a4b1-241e95fa0ca0 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bee2d5f599642788c32e0d8b8338c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e7d531c0f4a33a869309af965e3e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:53.297830 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-2d40c297-1880-4ab0-a4b1-241e95fa0ca0 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] 10.222.0.52 "GET /compute/v2.1/servers/ae78bc7d-2e36-42d6-bcef-686291983088" status: 200 len: 1327 microversion: 2.1 time: 0.097616 Oct 28 09:53:53.298410 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 395/774] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:53:53 2022] GET /compute/v2.1/servers/ae78bc7d-2e36-42d6-bcef-686291983088 => generated 1327 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:54.321777 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-3377e727-120b-4d8f-a1c4-61d03be63b6f tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:54.322476 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-3377e727-120b-4d8f-a1c4-61d03be63b6f tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] [instance: ae78bc7d-2e36-42d6-bcef-686291983088] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:54.328973 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-3377e727-120b-4d8f-a1c4-61d03be63b6f tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:54.329474 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-3377e727-120b-4d8f-a1c4-61d03be63b6f tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:54.329916 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-3377e727-120b-4d8f-a1c4-61d03be63b6f tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:54.330628 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-3377e727-120b-4d8f-a1c4-61d03be63b6f tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:54.331086 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-3377e727-120b-4d8f-a1c4-61d03be63b6f tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:54.331509 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-3377e727-120b-4d8f-a1c4-61d03be63b6f tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:54.347519 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.wsgi [None req-3377e727-120b-4d8f-a1c4-61d03be63b6f tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] HTTP exception thrown: Instance ae78bc7d-2e36-42d6-bcef-686291983088 could not be found. Oct 28 09:53:54.349255 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-3377e727-120b-4d8f-a1c4-61d03be63b6f tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Request method failure captured: Oct 28 09:53:54.349255 dv-cinder-zed-3-smb devstack@n-api.service[127033]: request: GET /compute/v2.1/servers/ae78bc7d-2e36-42d6-bcef-686291983088 HTTP/1.1 Oct 28 09:53:54.349255 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Accept: application/json Oct 28 09:53:54.349255 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Accept-Encoding: identity Oct 28 09:53:54.349255 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Connection: close Oct 28 09:53:54.349255 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Content-Length: 0 Oct 28 09:53:54.349255 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Content-Type: application/json Oct 28 09:53:54.349255 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Host: 10.222.0.52 Oct 28 09:53:54.349255 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Openstack-System-Scope: None Oct 28 09:53:54.349255 dv-cinder-zed-3-smb devstack@n-api.service[127033]: User-Agent: python-urllib3/1.26.12 Oct 28 09:53:54.349255 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Auth-Token: gAAAAABjW6TD9gyeIuaR3GZnkXNTUkXtEWiBtJhnH1ZHtIP9Q-UzXgQkL9OETwQ-XY-K-y6hcVC-UecjL0EOysrO2ml0mQLinXVtKN01SwTeCDiv6B_di23_WN7mIn7aa1bR2QSZEmjafQl67q_AfzlzMbAAzFQ1afrDtzqVY8EsC_V-oVdfohE Oct 28 09:53:54.349255 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Domain-Id: None Oct 28 09:53:54.349255 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Domain-Name: None Oct 28 09:53:54.349255 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Identity-Status: Confirmed Oct 28 09:53:54.349255 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Is-Admin-Project: True Oct 28 09:53:54.349255 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Project-Domain-Id: default Oct 28 09:53:54.349255 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Project-Domain-Name: Default Oct 28 09:53:54.349255 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Project-Id: ae5e7d531c0f4a33a869309af965e3e5 Oct 28 09:53:54.349255 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Project-Name: tempest-AttachVolumeTestJSON-520170005 Oct 28 09:53:54.349255 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Role: reader,member Oct 28 09:53:54.349255 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Roles: reader,member Oct 28 09:53:54.350895 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ae5e7d531c0f4a33a869309af965e3e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ae5e7d531c0f4a33a869309af965e3e5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ae5e7d531c0f4a33a869309af965e3e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ae5e7d531c0f4a33a869309af965e3e5"}]}] Oct 28 09:53:54.350895 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Tenant: tempest-AttachVolumeTestJSON-520170005 Oct 28 09:53:54.350895 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Tenant-Id: ae5e7d531c0f4a33a869309af965e3e5 Oct 28 09:53:54.350895 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Tenant-Name: tempest-AttachVolumeTestJSON-520170005 Oct 28 09:53:54.350895 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User: tempest-AttachVolumeTestJSON-520170005-project Oct 28 09:53:54.350895 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User-Domain-Id: default Oct 28 09:53:54.350895 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User-Domain-Name: Default Oct 28 09:53:54.350895 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User-Id: 8bee2d5f599642788c32e0d8b8338c19 Oct 28 09:53:54.350895 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User-Name: tempest-AttachVolumeTestJSON-520170005-project Oct 28 09:53:54.350895 dv-cinder-zed-3-smb devstack@n-api.service[127033]: method: > Oct 28 09:53:54.350895 dv-cinder-zed-3-smb devstack@n-api.service[127033]: exception: Instance ae78bc7d-2e36-42d6-bcef-686291983088 could not be found. Oct 28 09:53:54.350895 dv-cinder-zed-3-smb devstack@n-api.service[127033]: action_args: {'id': 'ae78bc7d-2e36-42d6-bcef-686291983088'} Oct 28 09:53:54.351819 dv-cinder-zed-3-smb devstack@n-api.service[127033]: {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:53:54.351819 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:53:54.351819 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 09:53:54.351819 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 09:53:54.351819 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 09:53:54.351819 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 09:53:54.351819 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 09:53:54.351819 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 09:53:54.351819 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 09:53:54.351819 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 09:53:54.351819 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae78bc7d-2e36-42d6-bcef-686291983088 could not be found. Oct 28 09:53:54.351819 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:53:54.351819 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:53:54.351819 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:53:54.351819 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:53:54.351819 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:53:54.351819 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:53:54.351819 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:53:54.351819 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:53:54.351819 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:53:54.353361 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:53:54.353361 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 09:53:54.353361 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 09:53:54.353361 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 09:53:54.353361 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 09:53:54.353361 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 09:53:54.353361 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 09:53:54.353361 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae78bc7d-2e36-42d6-bcef-686291983088 could not be found. Oct 28 09:53:54.353361 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:53:54.353361 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:53:54.353361 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:53:54.353361 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:53:54.353361 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:53:54.353361 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:53:54.353361 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:53:54.353361 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:53:54.353361 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae78bc7d-2e36-42d6-bcef-686291983088 could not be found. Oct 28 09:53:54.353361 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:53:54.355587 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-3377e727-120b-4d8f-a1c4-61d03be63b6f tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Returning 404 to user: Instance ae78bc7d-2e36-42d6-bcef-686291983088 could not be found. {{(pid=127033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:53:54.355587 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-3377e727-120b-4d8f-a1c4-61d03be63b6f tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] 10.222.0.52 "GET /compute/v2.1/servers/ae78bc7d-2e36-42d6-bcef-686291983088" status: 404 len: 111 microversion: 2.1 time: 0.033828 Oct 28 09:53:54.355587 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 380/775] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:53:54 2022] GET /compute/v2.1/servers/ae78bc7d-2e36-42d6-bcef-686291983088 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:53:54.361366 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-c0be9fb8-d1f0-4653-828e-43170f619612 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Calling method '.version_select at 0x7ff013b308b0>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:54.380422 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-c0be9fb8-d1f0-4653-828e-43170f619612 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1913484389" status: 202 len: 0 microversion: 2.1 time: 0.023401 Oct 28 09:53:54.380991 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 396/776] 10.222.0.52 () {58 vars in 1221 bytes} [Fri Oct 28 09:53:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1913484389 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:53:57.249588 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-4bdf2e90-857d-4db5-a3ca-6bd10d6e6aca tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:57.250092 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-4bdf2e90-857d-4db5-a3ca-6bd10d6e6aca tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] [instance: ae78bc7d-2e36-42d6-bcef-686291983088] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:57.256434 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-4bdf2e90-857d-4db5-a3ca-6bd10d6e6aca tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:57.256924 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-4bdf2e90-857d-4db5-a3ca-6bd10d6e6aca tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:57.257359 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-4bdf2e90-857d-4db5-a3ca-6bd10d6e6aca tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:57.258045 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-4bdf2e90-857d-4db5-a3ca-6bd10d6e6aca tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:57.258503 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-4bdf2e90-857d-4db5-a3ca-6bd10d6e6aca tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:57.258928 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-4bdf2e90-857d-4db5-a3ca-6bd10d6e6aca tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:57.272565 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.wsgi [None req-4bdf2e90-857d-4db5-a3ca-6bd10d6e6aca tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] HTTP exception thrown: Instance ae78bc7d-2e36-42d6-bcef-686291983088 could not be found. Oct 28 09:53:57.274097 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-4bdf2e90-857d-4db5-a3ca-6bd10d6e6aca tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Request method failure captured: Oct 28 09:53:57.274097 dv-cinder-zed-3-smb devstack@n-api.service[127033]: request: DELETE /compute/v2.1/servers/ae78bc7d-2e36-42d6-bcef-686291983088 HTTP/1.1 Oct 28 09:53:57.274097 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Accept: application/json Oct 28 09:53:57.274097 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Accept-Encoding: identity Oct 28 09:53:57.274097 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Connection: close Oct 28 09:53:57.274097 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Content-Length: 0 Oct 28 09:53:57.274097 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Content-Type: application/json Oct 28 09:53:57.274097 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Host: 10.222.0.52 Oct 28 09:53:57.274097 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Openstack-System-Scope: None Oct 28 09:53:57.274097 dv-cinder-zed-3-smb devstack@n-api.service[127033]: User-Agent: python-urllib3/1.26.12 Oct 28 09:53:57.274097 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Auth-Token: gAAAAABjW6TD9gyeIuaR3GZnkXNTUkXtEWiBtJhnH1ZHtIP9Q-UzXgQkL9OETwQ-XY-K-y6hcVC-UecjL0EOysrO2ml0mQLinXVtKN01SwTeCDiv6B_di23_WN7mIn7aa1bR2QSZEmjafQl67q_AfzlzMbAAzFQ1afrDtzqVY8EsC_V-oVdfohE Oct 28 09:53:57.274097 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Domain-Id: None Oct 28 09:53:57.274097 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Domain-Name: None Oct 28 09:53:57.274097 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Identity-Status: Confirmed Oct 28 09:53:57.274097 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Is-Admin-Project: True Oct 28 09:53:57.274097 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Project-Domain-Id: default Oct 28 09:53:57.274097 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Project-Domain-Name: Default Oct 28 09:53:57.274097 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Project-Id: ae5e7d531c0f4a33a869309af965e3e5 Oct 28 09:53:57.274097 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Project-Name: tempest-AttachVolumeTestJSON-520170005 Oct 28 09:53:57.274097 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Role: reader,member Oct 28 09:53:57.274097 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Roles: reader,member Oct 28 09:53:57.275609 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ae5e7d531c0f4a33a869309af965e3e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ae5e7d531c0f4a33a869309af965e3e5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ae5e7d531c0f4a33a869309af965e3e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ae5e7d531c0f4a33a869309af965e3e5"}]}] Oct 28 09:53:57.275609 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Tenant: tempest-AttachVolumeTestJSON-520170005 Oct 28 09:53:57.275609 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Tenant-Id: ae5e7d531c0f4a33a869309af965e3e5 Oct 28 09:53:57.275609 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Tenant-Name: tempest-AttachVolumeTestJSON-520170005 Oct 28 09:53:57.275609 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User: tempest-AttachVolumeTestJSON-520170005-project Oct 28 09:53:57.275609 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User-Domain-Id: default Oct 28 09:53:57.275609 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User-Domain-Name: Default Oct 28 09:53:57.275609 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User-Id: 8bee2d5f599642788c32e0d8b8338c19 Oct 28 09:53:57.275609 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User-Name: tempest-AttachVolumeTestJSON-520170005-project Oct 28 09:53:57.275609 dv-cinder-zed-3-smb devstack@n-api.service[127033]: method: > Oct 28 09:53:57.275609 dv-cinder-zed-3-smb devstack@n-api.service[127033]: exception: Instance ae78bc7d-2e36-42d6-bcef-686291983088 could not be found. Oct 28 09:53:57.275609 dv-cinder-zed-3-smb devstack@n-api.service[127033]: action_args: {'id': 'ae78bc7d-2e36-42d6-bcef-686291983088'} Oct 28 09:53:57.277334 dv-cinder-zed-3-smb devstack@n-api.service[127033]: {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:53:57.277334 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:53:57.277334 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 09:53:57.277334 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 09:53:57.277334 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 09:53:57.277334 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 09:53:57.277334 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 09:53:57.277334 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 09:53:57.277334 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 09:53:57.277334 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 09:53:57.277334 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae78bc7d-2e36-42d6-bcef-686291983088 could not be found. Oct 28 09:53:57.277334 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:53:57.277334 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:53:57.277334 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:53:57.277334 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:53:57.277334 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:53:57.277334 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:53:57.277334 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:53:57.277334 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:53:57.277334 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:53:57.278760 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:53:57.278760 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 09:53:57.278760 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 09:53:57.278760 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 09:53:57.278760 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 09:53:57.278760 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 09:53:57.278760 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 09:53:57.278760 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 09:53:57.278760 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 09:53:57.278760 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae78bc7d-2e36-42d6-bcef-686291983088 could not be found. Oct 28 09:53:57.278760 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:53:57.278760 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:53:57.278760 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:53:57.278760 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:53:57.278760 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:53:57.278760 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:53:57.278760 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:53:57.278760 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:53:57.278760 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae78bc7d-2e36-42d6-bcef-686291983088 could not be found. Oct 28 09:53:57.278760 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:53:57.280815 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-4bdf2e90-857d-4db5-a3ca-6bd10d6e6aca tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Returning 404 to user: Instance ae78bc7d-2e36-42d6-bcef-686291983088 could not be found. {{(pid=127033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:53:57.280815 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-4bdf2e90-857d-4db5-a3ca-6bd10d6e6aca tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] 10.222.0.52 "DELETE /compute/v2.1/servers/ae78bc7d-2e36-42d6-bcef-686291983088" status: 404 len: 111 microversion: 2.1 time: 0.029831 Oct 28 09:53:57.280815 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 381/777] 10.222.0.52 () {58 vars in 1239 bytes} [Fri Oct 28 09:53:57 2022] DELETE /compute/v2.1/servers/ae78bc7d-2e36-42d6-bcef-686291983088 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:53:57.285304 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-1eb41094-18e3-4d4f-8670-5d53c622ee48 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:57.285903 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-1eb41094-18e3-4d4f-8670-5d53c622ee48 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] [instance: ae78bc7d-2e36-42d6-bcef-686291983088] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:57.292334 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-1eb41094-18e3-4d4f-8670-5d53c622ee48 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:57.292812 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-1eb41094-18e3-4d4f-8670-5d53c622ee48 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:57.293248 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-1eb41094-18e3-4d4f-8670-5d53c622ee48 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:57.293932 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-1eb41094-18e3-4d4f-8670-5d53c622ee48 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:57.294389 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-1eb41094-18e3-4d4f-8670-5d53c622ee48 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:57.294813 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-1eb41094-18e3-4d4f-8670-5d53c622ee48 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:57.307643 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.wsgi [None req-1eb41094-18e3-4d4f-8670-5d53c622ee48 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] HTTP exception thrown: Instance ae78bc7d-2e36-42d6-bcef-686291983088 could not be found. Oct 28 09:53:57.309306 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-1eb41094-18e3-4d4f-8670-5d53c622ee48 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Request method failure captured: Oct 28 09:53:57.309306 dv-cinder-zed-3-smb devstack@n-api.service[127032]: request: GET /compute/v2.1/servers/ae78bc7d-2e36-42d6-bcef-686291983088 HTTP/1.1 Oct 28 09:53:57.309306 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Accept: application/json Oct 28 09:53:57.309306 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Accept-Encoding: identity Oct 28 09:53:57.309306 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Connection: close Oct 28 09:53:57.309306 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Content-Length: 0 Oct 28 09:53:57.309306 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Content-Type: application/json Oct 28 09:53:57.309306 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Host: 10.222.0.52 Oct 28 09:53:57.309306 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Openstack-System-Scope: None Oct 28 09:53:57.309306 dv-cinder-zed-3-smb devstack@n-api.service[127032]: User-Agent: python-urllib3/1.26.12 Oct 28 09:53:57.309306 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Auth-Token: gAAAAABjW6TD9gyeIuaR3GZnkXNTUkXtEWiBtJhnH1ZHtIP9Q-UzXgQkL9OETwQ-XY-K-y6hcVC-UecjL0EOysrO2ml0mQLinXVtKN01SwTeCDiv6B_di23_WN7mIn7aa1bR2QSZEmjafQl67q_AfzlzMbAAzFQ1afrDtzqVY8EsC_V-oVdfohE Oct 28 09:53:57.309306 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Domain-Id: None Oct 28 09:53:57.309306 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Domain-Name: None Oct 28 09:53:57.309306 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Identity-Status: Confirmed Oct 28 09:53:57.309306 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Is-Admin-Project: True Oct 28 09:53:57.309306 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Project-Domain-Id: default Oct 28 09:53:57.309306 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Project-Domain-Name: Default Oct 28 09:53:57.309306 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Project-Id: ae5e7d531c0f4a33a869309af965e3e5 Oct 28 09:53:57.309306 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Project-Name: tempest-AttachVolumeTestJSON-520170005 Oct 28 09:53:57.309306 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Role: reader,member Oct 28 09:53:57.309306 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Roles: reader,member Oct 28 09:53:57.310838 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ae5e7d531c0f4a33a869309af965e3e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ae5e7d531c0f4a33a869309af965e3e5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ae5e7d531c0f4a33a869309af965e3e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ae5e7d531c0f4a33a869309af965e3e5"}]}] Oct 28 09:53:57.310838 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Tenant: tempest-AttachVolumeTestJSON-520170005 Oct 28 09:53:57.310838 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Tenant-Id: ae5e7d531c0f4a33a869309af965e3e5 Oct 28 09:53:57.310838 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Tenant-Name: tempest-AttachVolumeTestJSON-520170005 Oct 28 09:53:57.310838 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-User: tempest-AttachVolumeTestJSON-520170005-project Oct 28 09:53:57.310838 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-User-Domain-Id: default Oct 28 09:53:57.310838 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-User-Domain-Name: Default Oct 28 09:53:57.310838 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-User-Id: 8bee2d5f599642788c32e0d8b8338c19 Oct 28 09:53:57.310838 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-User-Name: tempest-AttachVolumeTestJSON-520170005-project Oct 28 09:53:57.310838 dv-cinder-zed-3-smb devstack@n-api.service[127032]: method: > Oct 28 09:53:57.310838 dv-cinder-zed-3-smb devstack@n-api.service[127032]: exception: Instance ae78bc7d-2e36-42d6-bcef-686291983088 could not be found. Oct 28 09:53:57.310838 dv-cinder-zed-3-smb devstack@n-api.service[127032]: action_args: {'id': 'ae78bc7d-2e36-42d6-bcef-686291983088'} Oct 28 09:53:57.311724 dv-cinder-zed-3-smb devstack@n-api.service[127032]: {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:53:57.311724 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:53:57.311724 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 09:53:57.311724 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 09:53:57.311724 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 09:53:57.311724 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 09:53:57.311724 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 09:53:57.311724 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 09:53:57.311724 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 09:53:57.311724 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 09:53:57.311724 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae78bc7d-2e36-42d6-bcef-686291983088 could not be found. Oct 28 09:53:57.311724 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Oct 28 09:53:57.311724 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:53:57.311724 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Oct 28 09:53:57.311724 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:53:57.311724 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:53:57.311724 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:53:57.311724 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:53:57.311724 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:53:57.311724 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:53:57.313198 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:53:57.313198 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 09:53:57.313198 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 09:53:57.313198 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 09:53:57.313198 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 09:53:57.313198 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 09:53:57.313198 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 09:53:57.313198 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae78bc7d-2e36-42d6-bcef-686291983088 could not be found. Oct 28 09:53:57.313198 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Oct 28 09:53:57.313198 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:53:57.313198 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Oct 28 09:53:57.313198 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:53:57.313198 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:53:57.313198 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:53:57.313198 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:53:57.313198 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:53:57.313198 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae78bc7d-2e36-42d6-bcef-686291983088 could not be found. Oct 28 09:53:57.313198 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Oct 28 09:53:57.314534 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-1eb41094-18e3-4d4f-8670-5d53c622ee48 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Returning 404 to user: Instance ae78bc7d-2e36-42d6-bcef-686291983088 could not be found. {{(pid=127032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:53:57.314534 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-1eb41094-18e3-4d4f-8670-5d53c622ee48 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] 10.222.0.52 "GET /compute/v2.1/servers/ae78bc7d-2e36-42d6-bcef-686291983088" status: 404 len: 111 microversion: 2.1 time: 0.029907 Oct 28 09:53:57.314534 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 397/778] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:53:57 2022] GET /compute/v2.1/servers/ae78bc7d-2e36-42d6-bcef-686291983088 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:53:58.455558 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-9bbbbfee-ccf3-4e8b-b713-29a7e7231912 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:58.456188 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-9bbbbfee-ccf3-4e8b-b713-29a7e7231912 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] [instance: 91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:58.462508 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-9bbbbfee-ccf3-4e8b-b713-29a7e7231912 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:58.462987 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-9bbbbfee-ccf3-4e8b-b713-29a7e7231912 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:58.463413 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-9bbbbfee-ccf3-4e8b-b713-29a7e7231912 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:58.464129 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-9bbbbfee-ccf3-4e8b-b713-29a7e7231912 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:58.464575 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-9bbbbfee-ccf3-4e8b-b713-29a7e7231912 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:58.464994 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-9bbbbfee-ccf3-4e8b-b713-29a7e7231912 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:58.484888 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.wsgi [None req-9bbbbfee-ccf3-4e8b-b713-29a7e7231912 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] HTTP exception thrown: Instance 91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1 could not be found. Oct 28 09:53:58.486548 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-9bbbbfee-ccf3-4e8b-b713-29a7e7231912 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Request method failure captured: Oct 28 09:53:58.486548 dv-cinder-zed-3-smb devstack@n-api.service[127033]: request: DELETE /compute/v2.1/servers/91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1 HTTP/1.1 Oct 28 09:53:58.486548 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Accept: application/json Oct 28 09:53:58.486548 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Accept-Encoding: identity Oct 28 09:53:58.486548 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Connection: close Oct 28 09:53:58.486548 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Content-Length: 0 Oct 28 09:53:58.486548 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Content-Type: application/json Oct 28 09:53:58.486548 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Host: 10.222.0.52 Oct 28 09:53:58.486548 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Openstack-System-Scope: None Oct 28 09:53:58.486548 dv-cinder-zed-3-smb devstack@n-api.service[127033]: User-Agent: python-urllib3/1.26.12 Oct 28 09:53:58.486548 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Auth-Token: gAAAAABjW6TD9gyeIuaR3GZnkXNTUkXtEWiBtJhnH1ZHtIP9Q-UzXgQkL9OETwQ-XY-K-y6hcVC-UecjL0EOysrO2ml0mQLinXVtKN01SwTeCDiv6B_di23_WN7mIn7aa1bR2QSZEmjafQl67q_AfzlzMbAAzFQ1afrDtzqVY8EsC_V-oVdfohE Oct 28 09:53:58.486548 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Domain-Id: None Oct 28 09:53:58.486548 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Domain-Name: None Oct 28 09:53:58.486548 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Identity-Status: Confirmed Oct 28 09:53:58.486548 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Is-Admin-Project: True Oct 28 09:53:58.486548 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Project-Domain-Id: default Oct 28 09:53:58.486548 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Project-Domain-Name: Default Oct 28 09:53:58.486548 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Project-Id: ae5e7d531c0f4a33a869309af965e3e5 Oct 28 09:53:58.486548 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Project-Name: tempest-AttachVolumeTestJSON-520170005 Oct 28 09:53:58.486548 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Role: reader,member Oct 28 09:53:58.486548 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Roles: reader,member Oct 28 09:53:58.488443 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ae5e7d531c0f4a33a869309af965e3e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ae5e7d531c0f4a33a869309af965e3e5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ae5e7d531c0f4a33a869309af965e3e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ae5e7d531c0f4a33a869309af965e3e5"}]}] Oct 28 09:53:58.488443 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Tenant: tempest-AttachVolumeTestJSON-520170005 Oct 28 09:53:58.488443 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Tenant-Id: ae5e7d531c0f4a33a869309af965e3e5 Oct 28 09:53:58.488443 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Tenant-Name: tempest-AttachVolumeTestJSON-520170005 Oct 28 09:53:58.488443 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User: tempest-AttachVolumeTestJSON-520170005-project Oct 28 09:53:58.488443 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User-Domain-Id: default Oct 28 09:53:58.488443 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User-Domain-Name: Default Oct 28 09:53:58.488443 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User-Id: 8bee2d5f599642788c32e0d8b8338c19 Oct 28 09:53:58.488443 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User-Name: tempest-AttachVolumeTestJSON-520170005-project Oct 28 09:53:58.488443 dv-cinder-zed-3-smb devstack@n-api.service[127033]: method: > Oct 28 09:53:58.488443 dv-cinder-zed-3-smb devstack@n-api.service[127033]: exception: Instance 91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1 could not be found. Oct 28 09:53:58.488443 dv-cinder-zed-3-smb devstack@n-api.service[127033]: action_args: {'id': '91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1'} Oct 28 09:53:58.489404 dv-cinder-zed-3-smb devstack@n-api.service[127033]: {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:53:58.489404 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:53:58.489404 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 09:53:58.489404 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 09:53:58.489404 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 09:53:58.489404 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 09:53:58.489404 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 09:53:58.489404 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 09:53:58.489404 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 09:53:58.489404 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 09:53:58.489404 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1 could not be found. Oct 28 09:53:58.489404 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:53:58.489404 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:53:58.489404 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:53:58.489404 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:53:58.489404 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:53:58.489404 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:53:58.489404 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:53:58.489404 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:53:58.489404 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:53:58.491363 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:53:58.491363 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 09:53:58.491363 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 09:53:58.491363 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 09:53:58.491363 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 09:53:58.491363 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 09:53:58.491363 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 09:53:58.491363 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 09:53:58.491363 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 09:53:58.491363 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1 could not be found. Oct 28 09:53:58.491363 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:53:58.491363 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:53:58.491363 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:53:58.491363 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:53:58.491363 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:53:58.491363 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:53:58.491363 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:53:58.491363 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:53:58.491363 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1 could not be found. Oct 28 09:53:58.491363 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:53:58.492982 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-9bbbbfee-ccf3-4e8b-b713-29a7e7231912 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Returning 404 to user: Instance 91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1 could not be found. {{(pid=127033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:53:58.492982 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-9bbbbfee-ccf3-4e8b-b713-29a7e7231912 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] 10.222.0.52 "DELETE /compute/v2.1/servers/91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1" status: 404 len: 111 microversion: 2.1 time: 0.036685 Oct 28 09:53:58.492982 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 382/779] 10.222.0.52 () {58 vars in 1239 bytes} [Fri Oct 28 09:53:58 2022] DELETE /compute/v2.1/servers/91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:53:58.498103 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-c3a671ee-2145-479e-ad0e-826a1afdd308 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:58.498742 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-c3a671ee-2145-479e-ad0e-826a1afdd308 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] [instance: 91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:58.505313 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-c3a671ee-2145-479e-ad0e-826a1afdd308 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:58.505800 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-c3a671ee-2145-479e-ad0e-826a1afdd308 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:58.506242 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-c3a671ee-2145-479e-ad0e-826a1afdd308 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:58.506950 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-c3a671ee-2145-479e-ad0e-826a1afdd308 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:58.507407 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-c3a671ee-2145-479e-ad0e-826a1afdd308 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:58.507862 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-c3a671ee-2145-479e-ad0e-826a1afdd308 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:58.524202 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.wsgi [None req-c3a671ee-2145-479e-ad0e-826a1afdd308 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] HTTP exception thrown: Instance 91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1 could not be found. Oct 28 09:53:58.525792 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-c3a671ee-2145-479e-ad0e-826a1afdd308 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Request method failure captured: Oct 28 09:53:58.525792 dv-cinder-zed-3-smb devstack@n-api.service[127032]: request: GET /compute/v2.1/servers/91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1 HTTP/1.1 Oct 28 09:53:58.525792 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Accept: application/json Oct 28 09:53:58.525792 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Accept-Encoding: identity Oct 28 09:53:58.525792 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Connection: close Oct 28 09:53:58.525792 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Content-Length: 0 Oct 28 09:53:58.525792 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Content-Type: application/json Oct 28 09:53:58.525792 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Host: 10.222.0.52 Oct 28 09:53:58.525792 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Openstack-System-Scope: None Oct 28 09:53:58.525792 dv-cinder-zed-3-smb devstack@n-api.service[127032]: User-Agent: python-urllib3/1.26.12 Oct 28 09:53:58.525792 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Auth-Token: gAAAAABjW6TD9gyeIuaR3GZnkXNTUkXtEWiBtJhnH1ZHtIP9Q-UzXgQkL9OETwQ-XY-K-y6hcVC-UecjL0EOysrO2ml0mQLinXVtKN01SwTeCDiv6B_di23_WN7mIn7aa1bR2QSZEmjafQl67q_AfzlzMbAAzFQ1afrDtzqVY8EsC_V-oVdfohE Oct 28 09:53:58.525792 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Domain-Id: None Oct 28 09:53:58.525792 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Domain-Name: None Oct 28 09:53:58.525792 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Identity-Status: Confirmed Oct 28 09:53:58.525792 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Is-Admin-Project: True Oct 28 09:53:58.525792 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Project-Domain-Id: default Oct 28 09:53:58.525792 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Project-Domain-Name: Default Oct 28 09:53:58.525792 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Project-Id: ae5e7d531c0f4a33a869309af965e3e5 Oct 28 09:53:58.525792 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Project-Name: tempest-AttachVolumeTestJSON-520170005 Oct 28 09:53:58.525792 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Role: reader,member Oct 28 09:53:58.525792 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Roles: reader,member Oct 28 09:53:58.527376 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ae5e7d531c0f4a33a869309af965e3e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ae5e7d531c0f4a33a869309af965e3e5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ae5e7d531c0f4a33a869309af965e3e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ae5e7d531c0f4a33a869309af965e3e5"}]}] Oct 28 09:53:58.527376 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Tenant: tempest-AttachVolumeTestJSON-520170005 Oct 28 09:53:58.527376 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Tenant-Id: ae5e7d531c0f4a33a869309af965e3e5 Oct 28 09:53:58.527376 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Tenant-Name: tempest-AttachVolumeTestJSON-520170005 Oct 28 09:53:58.527376 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-User: tempest-AttachVolumeTestJSON-520170005-project Oct 28 09:53:58.527376 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-User-Domain-Id: default Oct 28 09:53:58.527376 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-User-Domain-Name: Default Oct 28 09:53:58.527376 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-User-Id: 8bee2d5f599642788c32e0d8b8338c19 Oct 28 09:53:58.527376 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-User-Name: tempest-AttachVolumeTestJSON-520170005-project Oct 28 09:53:58.527376 dv-cinder-zed-3-smb devstack@n-api.service[127032]: method: > Oct 28 09:53:58.527376 dv-cinder-zed-3-smb devstack@n-api.service[127032]: exception: Instance 91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1 could not be found. Oct 28 09:53:58.527376 dv-cinder-zed-3-smb devstack@n-api.service[127032]: action_args: {'id': '91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1'} Oct 28 09:53:58.528369 dv-cinder-zed-3-smb devstack@n-api.service[127032]: {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:53:58.528369 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:53:58.528369 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 09:53:58.528369 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 09:53:58.528369 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 09:53:58.528369 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 09:53:58.528369 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 09:53:58.528369 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 09:53:58.528369 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 09:53:58.528369 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 09:53:58.528369 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1 could not be found. Oct 28 09:53:58.528369 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Oct 28 09:53:58.528369 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:53:58.528369 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Oct 28 09:53:58.528369 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:53:58.528369 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:53:58.528369 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:53:58.528369 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:53:58.528369 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:53:58.528369 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:53:58.530462 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:53:58.530462 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 09:53:58.530462 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 09:53:58.530462 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 09:53:58.530462 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 09:53:58.530462 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 09:53:58.530462 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 09:53:58.530462 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1 could not be found. Oct 28 09:53:58.530462 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Oct 28 09:53:58.530462 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:53:58.530462 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Oct 28 09:53:58.530462 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:53:58.530462 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:53:58.530462 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:53:58.530462 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:53:58.530462 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:53:58.530462 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1 could not be found. Oct 28 09:53:58.530462 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Oct 28 09:53:58.531715 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-c3a671ee-2145-479e-ad0e-826a1afdd308 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] Returning 404 to user: Instance 91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1 could not be found. {{(pid=127032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:53:58.531715 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-c3a671ee-2145-479e-ad0e-826a1afdd308 tempest-AttachVolumeTestJSON-520170005 tempest-AttachVolumeTestJSON-520170005-project] 10.222.0.52 "GET /compute/v2.1/servers/91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1" status: 404 len: 111 microversion: 2.1 time: 0.033300 Oct 28 09:53:58.531715 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 398/780] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:53:58 2022] GET /compute/v2.1/servers/91b2bb7f-6fe7-48fe-8cfc-d6eaa82b5ac1 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 09:54:03.438120 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-3a001e9b-b0ed-4234-b7ea-81496f42a9fa tempest-VolumesNegativeTest-12972343 tempest-VolumesNegativeTest-12972343-project] Action: 'create', calling method: .version_select at 0x7ff0101093a0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1328144614", "metadata": {"Type": "work"}}} {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:54:03.454282 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-3a001e9b-b0ed-4234-b7ea-81496f42a9fa tempest-VolumesNegativeTest-12972343 tempest-VolumesNegativeTest-12972343-project] Request method failure captured: Oct 28 09:54:03.454282 dv-cinder-zed-3-smb devstack@n-api.service[127033]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 28 09:54:03.454282 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Accept: application/json Oct 28 09:54:03.454282 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Accept-Encoding: identity Oct 28 09:54:03.454282 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Connection: close Oct 28 09:54:03.454282 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Content-Length: 122 Oct 28 09:54:03.454282 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Content-Type: application/json Oct 28 09:54:03.454282 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Host: 10.222.0.52 Oct 28 09:54:03.454282 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Openstack-System-Scope: None Oct 28 09:54:03.454282 dv-cinder-zed-3-smb devstack@n-api.service[127033]: User-Agent: python-urllib3/1.26.12 Oct 28 09:54:03.454282 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Auth-Token: gAAAAABjW6a7OQQb4c2HiMw6iebLfi47MjQCloPweO1B7hvQy9QT0I67pgZ7s1cw0BMevB9NP9l-6m_JgG3jsd_tDh0DcVDD0vCo_j1I9Y_aRpL2p6xlIIH0OkSI9xGJZ8mBXqTPbiPH3hqgLtlKdMYV_7ACEZF54yO1SjyQ0tkRwm7u8w597-g Oct 28 09:54:03.454282 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Domain-Id: None Oct 28 09:54:03.454282 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Domain-Name: None Oct 28 09:54:03.454282 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Identity-Status: Confirmed Oct 28 09:54:03.454282 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Is-Admin-Project: True Oct 28 09:54:03.454282 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Project-Domain-Id: default Oct 28 09:54:03.454282 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Project-Domain-Name: Default Oct 28 09:54:03.454282 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Project-Id: af86914d649d4cd88a7366c0693ab438 Oct 28 09:54:03.454282 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Project-Name: tempest-VolumesNegativeTest-12972343 Oct 28 09:54:03.454282 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Role: reader,member Oct 28 09:54:03.454282 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Roles: reader,member Oct 28 09:54:03.456057 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_af86914d649d4cd88a7366c0693ab438"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/af86914d649d4cd88a7366c0693ab438"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/af86914d649d4cd88a7366c0693ab438"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/af86914d649d4cd88a7366c0693ab438"}]}] Oct 28 09:54:03.456057 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Tenant: tempest-VolumesNegativeTest-12972343 Oct 28 09:54:03.456057 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Tenant-Id: af86914d649d4cd88a7366c0693ab438 Oct 28 09:54:03.456057 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Tenant-Name: tempest-VolumesNegativeTest-12972343 Oct 28 09:54:03.456057 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User: tempest-VolumesNegativeTest-12972343-project Oct 28 09:54:03.456057 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User-Domain-Id: default Oct 28 09:54:03.456057 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User-Domain-Name: Default Oct 28 09:54:03.456057 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User-Id: 27d120bc73eb4bbea72153707d6e5caa Oct 28 09:54:03.456057 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User-Name: tempest-VolumesNegativeTest-12972343-project Oct 28 09:54:03.456057 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Oct 28 09:54:03.456057 dv-cinder-zed-3-smb devstack@n-api.service[127033]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1328144614", "metadata": {"Type": "work"}}} Oct 28 09:54:03.456057 dv-cinder-zed-3-smb devstack@n-api.service[127033]: method: Oct 28 09:54:03.456057 dv-cinder-zed-3-smb devstack@n-api.service[127033]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 28 09:54:03.457178 dv-cinder-zed-3-smb devstack@n-api.service[127033]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1328144614', 'metadata': {'Type': 'work'}}}} Oct 28 09:54:03.457178 dv-cinder-zed-3-smb devstack@n-api.service[127033]: {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:54:03.457178 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:54:03.457178 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 09:54:03.457178 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 09:54:03.457178 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 09:54:03.457178 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi raise error Oct 28 09:54:03.457178 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Oct 28 09:54:03.457178 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:54:03.457178 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 28 09:54:03.457178 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 28 09:54:03.457178 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:54:03.457178 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 28 09:54:03.457178 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi '#$%' Oct 28 09:54:03.457178 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:54:03.457178 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:54:03.457178 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:54:03.457178 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:54:03.457178 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:54:03.457178 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:54:03.457178 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:54:03.457178 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:54:03.458967 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 09:54:03.458967 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 09:54:03.458967 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:54:03.458967 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:54:03.458967 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 09:54:03.458967 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 09:54:03.458967 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 09:54:03.458967 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 09:54:03.458967 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 09:54:03.458967 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 09:54:03.458967 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 28 09:54:03.458967 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:54:03.458967 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:54:03.458967 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:54:03.458967 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:54:03.458967 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:54:03.458967 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:54:03.458967 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 09:54:03.458967 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 09:54:03.460514 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 28 09:54:03.460514 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:54:03.460514 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-3a001e9b-b0ed-4234-b7ea-81496f42a9fa tempest-VolumesNegativeTest-12972343 tempest-VolumesNegativeTest-12972343-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=127033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:54:03.460514 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-3a001e9b-b0ed-4234-b7ea-81496f42a9fa tempest-VolumesNegativeTest-12972343 tempest-VolumesNegativeTest-12972343-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.163031 Oct 28 09:54:03.460514 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 383/781] 10.222.0.52 () {60 vars in 1156 bytes} [Fri Oct 28 09:54:03 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 164 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 09:54:03.465993 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-6ef83009-cdca-40da-b526-0df68ea26f87 tempest-VolumesNegativeTest-12972343 tempest-VolumesNegativeTest-12972343-project] Action: 'create', calling method: .version_select at 0x7ff013b481f0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-651712582", "metadata": {"Type": "work"}}} {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:54:03.470981 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-6ef83009-cdca-40da-b526-0df68ea26f87 tempest-VolumesNegativeTest-12972343 tempest-VolumesNegativeTest-12972343-project] Request method failure captured: Oct 28 09:54:03.470981 dv-cinder-zed-3-smb devstack@n-api.service[127032]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 28 09:54:03.470981 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Accept: application/json Oct 28 09:54:03.470981 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Accept-Encoding: identity Oct 28 09:54:03.470981 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Connection: close Oct 28 09:54:03.470981 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Content-Length: 119 Oct 28 09:54:03.470981 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Content-Type: application/json Oct 28 09:54:03.470981 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Host: 10.222.0.52 Oct 28 09:54:03.470981 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Openstack-System-Scope: None Oct 28 09:54:03.470981 dv-cinder-zed-3-smb devstack@n-api.service[127032]: User-Agent: python-urllib3/1.26.12 Oct 28 09:54:03.470981 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Auth-Token: gAAAAABjW6a7OQQb4c2HiMw6iebLfi47MjQCloPweO1B7hvQy9QT0I67pgZ7s1cw0BMevB9NP9l-6m_JgG3jsd_tDh0DcVDD0vCo_j1I9Y_aRpL2p6xlIIH0OkSI9xGJZ8mBXqTPbiPH3hqgLtlKdMYV_7ACEZF54yO1SjyQ0tkRwm7u8w597-g Oct 28 09:54:03.470981 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Domain-Id: None Oct 28 09:54:03.470981 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Domain-Name: None Oct 28 09:54:03.470981 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Identity-Status: Confirmed Oct 28 09:54:03.470981 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Is-Admin-Project: True Oct 28 09:54:03.470981 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Project-Domain-Id: default Oct 28 09:54:03.470981 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Project-Domain-Name: Default Oct 28 09:54:03.470981 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Project-Id: af86914d649d4cd88a7366c0693ab438 Oct 28 09:54:03.470981 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Project-Name: tempest-VolumesNegativeTest-12972343 Oct 28 09:54:03.470981 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Role: reader,member Oct 28 09:54:03.470981 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Roles: reader,member Oct 28 09:54:03.472629 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_af86914d649d4cd88a7366c0693ab438"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/af86914d649d4cd88a7366c0693ab438"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/af86914d649d4cd88a7366c0693ab438"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/af86914d649d4cd88a7366c0693ab438"}]}] Oct 28 09:54:03.472629 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Tenant: tempest-VolumesNegativeTest-12972343 Oct 28 09:54:03.472629 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Tenant-Id: af86914d649d4cd88a7366c0693ab438 Oct 28 09:54:03.472629 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Tenant-Name: tempest-VolumesNegativeTest-12972343 Oct 28 09:54:03.472629 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-User: tempest-VolumesNegativeTest-12972343-project Oct 28 09:54:03.472629 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-User-Domain-Id: default Oct 28 09:54:03.472629 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-User-Domain-Name: Default Oct 28 09:54:03.472629 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-User-Id: 27d120bc73eb4bbea72153707d6e5caa Oct 28 09:54:03.472629 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-User-Name: tempest-VolumesNegativeTest-12972343-project Oct 28 09:54:03.472629 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Oct 28 09:54:03.472629 dv-cinder-zed-3-smb devstack@n-api.service[127032]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-651712582", "metadata": {"Type": "work"}}} Oct 28 09:54:03.472629 dv-cinder-zed-3-smb devstack@n-api.service[127032]: method: Oct 28 09:54:03.472629 dv-cinder-zed-3-smb devstack@n-api.service[127032]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 28 09:54:03.473595 dv-cinder-zed-3-smb devstack@n-api.service[127032]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-651712582', 'metadata': {'Type': 'work'}}}} Oct 28 09:54:03.473595 dv-cinder-zed-3-smb devstack@n-api.service[127032]: {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:54:03.473595 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:54:03.473595 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 09:54:03.473595 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 09:54:03.473595 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 09:54:03.473595 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi raise error Oct 28 09:54:03.473595 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 28 09:54:03.473595 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Oct 28 09:54:03.473595 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Oct 28 09:54:03.473595 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 28 09:54:03.473595 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Oct 28 09:54:03.473595 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 28 09:54:03.473595 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi '0' Oct 28 09:54:03.473595 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Oct 28 09:54:03.473595 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:54:03.473595 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Oct 28 09:54:03.473595 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:54:03.473595 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:54:03.473595 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:54:03.473595 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:54:03.473595 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:54:03.475605 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 09:54:03.475605 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 09:54:03.475605 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:54:03.475605 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:54:03.475605 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 09:54:03.475605 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 09:54:03.475605 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 09:54:03.475605 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 09:54:03.475605 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 09:54:03.475605 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 09:54:03.475605 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 28 09:54:03.475605 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Oct 28 09:54:03.475605 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:54:03.475605 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Oct 28 09:54:03.475605 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:54:03.475605 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:54:03.475605 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:54:03.475605 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 09:54:03.475605 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 09:54:03.476866 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 28 09:54:03.476866 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Oct 28 09:54:03.476866 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-6ef83009-cdca-40da-b526-0df68ea26f87 tempest-VolumesNegativeTest-12972343 tempest-VolumesNegativeTest-12972343-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=127032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:54:03.476866 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-6ef83009-cdca-40da-b526-0df68ea26f87 tempest-VolumesNegativeTest-12972343 tempest-VolumesNegativeTest-12972343-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010496 Oct 28 09:54:03.476866 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 399/782] 10.222.0.52 () {60 vars in 1156 bytes} [Fri Oct 28 09:54:03 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 28 09:54:03.483036 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-ce370663-fd50-4d04-b82f-152b1b55f4c5 tempest-VolumesNegativeTest-12972343 tempest-VolumesNegativeTest-12972343-project] Action: 'create', calling method: .version_select at 0x7ff0101119d0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2117696021", "metadata": {"Type": "work"}}} {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:54:03.487652 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-ce370663-fd50-4d04-b82f-152b1b55f4c5 tempest-VolumesNegativeTest-12972343 tempest-VolumesNegativeTest-12972343-project] Request method failure captured: Oct 28 09:54:03.487652 dv-cinder-zed-3-smb devstack@n-api.service[127033]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 28 09:54:03.487652 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Accept: application/json Oct 28 09:54:03.487652 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Accept-Encoding: identity Oct 28 09:54:03.487652 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Connection: close Oct 28 09:54:03.487652 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Content-Length: 119 Oct 28 09:54:03.487652 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Content-Type: application/json Oct 28 09:54:03.487652 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Host: 10.222.0.52 Oct 28 09:54:03.487652 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Openstack-System-Scope: None Oct 28 09:54:03.487652 dv-cinder-zed-3-smb devstack@n-api.service[127033]: User-Agent: python-urllib3/1.26.12 Oct 28 09:54:03.487652 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Auth-Token: gAAAAABjW6a7OQQb4c2HiMw6iebLfi47MjQCloPweO1B7hvQy9QT0I67pgZ7s1cw0BMevB9NP9l-6m_JgG3jsd_tDh0DcVDD0vCo_j1I9Y_aRpL2p6xlIIH0OkSI9xGJZ8mBXqTPbiPH3hqgLtlKdMYV_7ACEZF54yO1SjyQ0tkRwm7u8w597-g Oct 28 09:54:03.487652 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Domain-Id: None Oct 28 09:54:03.487652 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Domain-Name: None Oct 28 09:54:03.487652 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Identity-Status: Confirmed Oct 28 09:54:03.487652 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Is-Admin-Project: True Oct 28 09:54:03.487652 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Project-Domain-Id: default Oct 28 09:54:03.487652 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Project-Domain-Name: Default Oct 28 09:54:03.487652 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Project-Id: af86914d649d4cd88a7366c0693ab438 Oct 28 09:54:03.487652 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Project-Name: tempest-VolumesNegativeTest-12972343 Oct 28 09:54:03.487652 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Role: reader,member Oct 28 09:54:03.487652 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Roles: reader,member Oct 28 09:54:03.490742 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_af86914d649d4cd88a7366c0693ab438"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/af86914d649d4cd88a7366c0693ab438"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/af86914d649d4cd88a7366c0693ab438"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/af86914d649d4cd88a7366c0693ab438"}]}] Oct 28 09:54:03.490742 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Tenant: tempest-VolumesNegativeTest-12972343 Oct 28 09:54:03.490742 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Tenant-Id: af86914d649d4cd88a7366c0693ab438 Oct 28 09:54:03.490742 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Tenant-Name: tempest-VolumesNegativeTest-12972343 Oct 28 09:54:03.490742 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User: tempest-VolumesNegativeTest-12972343-project Oct 28 09:54:03.490742 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User-Domain-Id: default Oct 28 09:54:03.490742 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User-Domain-Name: Default Oct 28 09:54:03.490742 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User-Id: 27d120bc73eb4bbea72153707d6e5caa Oct 28 09:54:03.490742 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User-Name: tempest-VolumesNegativeTest-12972343-project Oct 28 09:54:03.490742 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Oct 28 09:54:03.490742 dv-cinder-zed-3-smb devstack@n-api.service[127033]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2117696021", "metadata": {"Type": "work"}}} Oct 28 09:54:03.490742 dv-cinder-zed-3-smb devstack@n-api.service[127033]: method: Oct 28 09:54:03.490742 dv-cinder-zed-3-smb devstack@n-api.service[127033]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 28 09:54:03.492845 dv-cinder-zed-3-smb devstack@n-api.service[127033]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-2117696021', 'metadata': {'Type': 'work'}}}} Oct 28 09:54:03.492845 dv-cinder-zed-3-smb devstack@n-api.service[127033]: {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:54:03.492845 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:54:03.492845 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 09:54:03.492845 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 09:54:03.492845 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 09:54:03.492845 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi raise error Oct 28 09:54:03.492845 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Oct 28 09:54:03.492845 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:54:03.492845 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 28 09:54:03.492845 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 28 09:54:03.492845 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:54:03.492845 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 28 09:54:03.492845 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi '' Oct 28 09:54:03.492845 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:54:03.492845 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:54:03.492845 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:54:03.492845 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:54:03.492845 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:54:03.492845 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:54:03.492845 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:54:03.492845 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:54:03.495905 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 09:54:03.495905 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 09:54:03.495905 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:54:03.495905 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:54:03.495905 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 09:54:03.495905 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 09:54:03.495905 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 09:54:03.495905 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 09:54:03.495905 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 09:54:03.495905 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 09:54:03.495905 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 28 09:54:03.495905 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:54:03.495905 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:54:03.495905 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:54:03.495905 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:54:03.495905 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:54:03.495905 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:54:03.495905 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 09:54:03.495905 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 09:54:03.498052 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 28 09:54:03.498052 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:54:03.498052 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-ce370663-fd50-4d04-b82f-152b1b55f4c5 tempest-VolumesNegativeTest-12972343 tempest-VolumesNegativeTest-12972343-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=127033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:54:03.498052 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-ce370663-fd50-4d04-b82f-152b1b55f4c5 tempest-VolumesNegativeTest-12972343 tempest-VolumesNegativeTest-12972343-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.010206 Oct 28 09:54:03.498052 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 384/783] 10.222.0.52 () {60 vars in 1156 bytes} [Fri Oct 28 09:54:03 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 28 09:54:03.500978 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-37518ac4-d562-492c-bba9-fa0cb86b9a3b tempest-VolumesNegativeTest-12972343 tempest-VolumesNegativeTest-12972343-project] Calling method '.version_select at 0x7ff013b30af0>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:03.530579 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.wsgi [None req-37518ac4-d562-492c-bba9-fa0cb86b9a3b tempest-VolumesNegativeTest-12972343 tempest-VolumesNegativeTest-12972343-project] HTTP exception thrown: Volume tempest-invalid-5300994 could not be found. Oct 28 09:54:03.534160 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-37518ac4-d562-492c-bba9-fa0cb86b9a3b tempest-VolumesNegativeTest-12972343 tempest-VolumesNegativeTest-12972343-project] Request method failure captured: Oct 28 09:54:03.534160 dv-cinder-zed-3-smb devstack@n-api.service[127032]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-5300994 HTTP/1.1 Oct 28 09:54:03.534160 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Accept: application/json Oct 28 09:54:03.534160 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Accept-Encoding: identity Oct 28 09:54:03.534160 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Connection: close Oct 28 09:54:03.534160 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Content-Length: 0 Oct 28 09:54:03.534160 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Content-Type: application/json Oct 28 09:54:03.534160 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Host: 10.222.0.52 Oct 28 09:54:03.534160 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Openstack-System-Scope: None Oct 28 09:54:03.534160 dv-cinder-zed-3-smb devstack@n-api.service[127032]: User-Agent: python-urllib3/1.26.12 Oct 28 09:54:03.534160 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Auth-Token: gAAAAABjW6a7OQQb4c2HiMw6iebLfi47MjQCloPweO1B7hvQy9QT0I67pgZ7s1cw0BMevB9NP9l-6m_JgG3jsd_tDh0DcVDD0vCo_j1I9Y_aRpL2p6xlIIH0OkSI9xGJZ8mBXqTPbiPH3hqgLtlKdMYV_7ACEZF54yO1SjyQ0tkRwm7u8w597-g Oct 28 09:54:03.534160 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Domain-Id: None Oct 28 09:54:03.534160 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Domain-Name: None Oct 28 09:54:03.534160 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Identity-Status: Confirmed Oct 28 09:54:03.534160 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Is-Admin-Project: True Oct 28 09:54:03.534160 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Project-Domain-Id: default Oct 28 09:54:03.534160 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Project-Domain-Name: Default Oct 28 09:54:03.534160 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Project-Id: af86914d649d4cd88a7366c0693ab438 Oct 28 09:54:03.534160 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Project-Name: tempest-VolumesNegativeTest-12972343 Oct 28 09:54:03.534160 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Role: reader,member Oct 28 09:54:03.534160 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Roles: reader,member Oct 28 09:54:03.535785 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_af86914d649d4cd88a7366c0693ab438"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/af86914d649d4cd88a7366c0693ab438"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/af86914d649d4cd88a7366c0693ab438"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/af86914d649d4cd88a7366c0693ab438"}]}] Oct 28 09:54:03.535785 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Tenant: tempest-VolumesNegativeTest-12972343 Oct 28 09:54:03.535785 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Tenant-Id: af86914d649d4cd88a7366c0693ab438 Oct 28 09:54:03.535785 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Tenant-Name: tempest-VolumesNegativeTest-12972343 Oct 28 09:54:03.535785 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-User: tempest-VolumesNegativeTest-12972343-project Oct 28 09:54:03.535785 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-User-Domain-Id: default Oct 28 09:54:03.535785 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-User-Domain-Name: Default Oct 28 09:54:03.535785 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-User-Id: 27d120bc73eb4bbea72153707d6e5caa Oct 28 09:54:03.535785 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-User-Name: tempest-VolumesNegativeTest-12972343-project Oct 28 09:54:03.535785 dv-cinder-zed-3-smb devstack@n-api.service[127032]: method: Oct 28 09:54:03.535785 dv-cinder-zed-3-smb devstack@n-api.service[127032]: exception: Volume tempest-invalid-5300994 could not be found. Oct 28 09:54:03.535785 dv-cinder-zed-3-smb devstack@n-api.service[127032]: action_args: {'id': 'tempest-invalid-5300994'} Oct 28 09:54:03.535785 dv-cinder-zed-3-smb devstack@n-api.service[127032]: {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:54:03.536673 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:54:03.536673 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 28 09:54:03.536673 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 28 09:54:03.536673 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 28 09:54:03.536673 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 28 09:54:03.536673 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 28 09:54:03.536673 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 28 09:54:03.536673 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 28 09:54:03.536673 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 28 09:54:03.536673 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 28 09:54:03.536673 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 28 09:54:03.536673 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 28 09:54:03.536673 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 28 09:54:03.536673 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 28 09:54:03.536673 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 28 09:54:03.536673 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-5300994 could not be found. (HTTP 404) (Request-ID: req-78f1600d-840b-4800-b971-88e5c4db9900) Oct 28 09:54:03.536673 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Oct 28 09:54:03.536673 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:54:03.536673 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Oct 28 09:54:03.538169 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:54:03.538169 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 28 09:54:03.538169 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 28 09:54:03.538169 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 28 09:54:03.538169 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 28 09:54:03.538169 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 28 09:54:03.538169 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 28 09:54:03.538169 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 28 09:54:03.538169 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 28 09:54:03.538169 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 28 09:54:03.538169 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 28 09:54:03.538169 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 28 09:54:03.538169 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 28 09:54:03.538169 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 28 09:54:03.538169 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 28 09:54:03.538169 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 28 09:54:03.538169 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 28 09:54:03.538169 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 28 09:54:03.538169 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 28 09:54:03.539461 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 28 09:54:03.539461 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 28 09:54:03.539461 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 28 09:54:03.539461 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 28 09:54:03.539461 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-5300994 could not be found. Oct 28 09:54:03.539461 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Oct 28 09:54:03.539461 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:54:03.539461 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Oct 28 09:54:03.539461 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:54:03.539461 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:54:03.539461 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:54:03.539461 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:54:03.539461 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:54:03.539461 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 09:54:03.539461 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 09:54:03.539461 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:54:03.539461 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:54:03.539461 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 28 09:54:03.539461 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 09:54:03.539461 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-5300994 could not be found. Oct 28 09:54:03.541109 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Oct 28 09:54:03.541109 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:54:03.541109 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Oct 28 09:54:03.541109 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:54:03.541109 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:54:03.541109 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:54:03.541109 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:54:03.541109 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:54:03.541109 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-5300994 could not be found. Oct 28 09:54:03.541109 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Oct 28 09:54:03.541109 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-37518ac4-d562-492c-bba9-fa0cb86b9a3b tempest-VolumesNegativeTest-12972343 tempest-VolumesNegativeTest-12972343-project] Returning 404 to user: Volume tempest-invalid-5300994 could not be found. {{(pid=127032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:54:03.541109 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-37518ac4-d562-492c-bba9-fa0cb86b9a3b tempest-VolumesNegativeTest-12972343 tempest-VolumesNegativeTest-12972343-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/tempest-invalid-5300994" status: 404 len: 96 microversion: 2.1 time: 0.039631 Oct 28 09:54:03.541109 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 400/784] 10.222.0.52 () {58 vars in 1209 bytes} [Fri Oct 28 09:54:03 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-5300994 => generated 96 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 28 09:54:03.557198 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-58c82331-1a6e-497e-807c-11a77e56a9f6 tempest-VolumesNegativeTest-12972343 tempest-VolumesNegativeTest-12972343-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.015604 Oct 28 09:54:03.557786 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 385/785] 10.222.0.52 () {58 vars in 1140 bytes} [Fri Oct 28 09:54:03 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 17 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 28 09:54:03.567314 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-8e516b68-86c1-47aa-a093-9c9c15b414b3 tempest-VolumesNegativeTest-12972343 tempest-VolumesNegativeTest-12972343-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003840 Oct 28 09:54:03.567834 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 401/786] 10.222.0.52 () {58 vars in 1137 bytes} [Fri Oct 28 09:54:03 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Oct 28 09:54:03.579782 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-1fa312c9-39ac-4a67-ac73-76db097288d3 tempest-VolumesNegativeTest-12972343 tempest-VolumesNegativeTest-12972343-project] Calling method '.version_select at 0x7ff0102cda60>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:03.610435 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.wsgi [None req-1fa312c9-39ac-4a67-ac73-76db097288d3 tempest-VolumesNegativeTest-12972343 tempest-VolumesNegativeTest-12972343-project] HTTP exception thrown: Volume 17028d75-3632-4b75-9e3d-77b5f0c15071 could not be found. Oct 28 09:54:03.613259 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-1fa312c9-39ac-4a67-ac73-76db097288d3 tempest-VolumesNegativeTest-12972343 tempest-VolumesNegativeTest-12972343-project] Request method failure captured: Oct 28 09:54:03.613259 dv-cinder-zed-3-smb devstack@n-api.service[127033]: request: DELETE /compute/v2.1/os-volumes/17028d75-3632-4b75-9e3d-77b5f0c15071 HTTP/1.1 Oct 28 09:54:03.613259 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Accept: application/json Oct 28 09:54:03.613259 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Accept-Encoding: identity Oct 28 09:54:03.613259 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Connection: close Oct 28 09:54:03.613259 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Content-Length: 0 Oct 28 09:54:03.613259 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Content-Type: application/json Oct 28 09:54:03.613259 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Host: 10.222.0.52 Oct 28 09:54:03.613259 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Openstack-System-Scope: None Oct 28 09:54:03.613259 dv-cinder-zed-3-smb devstack@n-api.service[127033]: User-Agent: python-urllib3/1.26.12 Oct 28 09:54:03.613259 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Auth-Token: gAAAAABjW6a7OQQb4c2HiMw6iebLfi47MjQCloPweO1B7hvQy9QT0I67pgZ7s1cw0BMevB9NP9l-6m_JgG3jsd_tDh0DcVDD0vCo_j1I9Y_aRpL2p6xlIIH0OkSI9xGJZ8mBXqTPbiPH3hqgLtlKdMYV_7ACEZF54yO1SjyQ0tkRwm7u8w597-g Oct 28 09:54:03.613259 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Domain-Id: None Oct 28 09:54:03.613259 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Domain-Name: None Oct 28 09:54:03.613259 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Identity-Status: Confirmed Oct 28 09:54:03.613259 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Is-Admin-Project: True Oct 28 09:54:03.613259 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Project-Domain-Id: default Oct 28 09:54:03.613259 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Project-Domain-Name: Default Oct 28 09:54:03.613259 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Project-Id: af86914d649d4cd88a7366c0693ab438 Oct 28 09:54:03.613259 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Project-Name: tempest-VolumesNegativeTest-12972343 Oct 28 09:54:03.613259 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Role: reader,member Oct 28 09:54:03.613259 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Roles: reader,member Oct 28 09:54:03.614828 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_af86914d649d4cd88a7366c0693ab438"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/af86914d649d4cd88a7366c0693ab438"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/af86914d649d4cd88a7366c0693ab438"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/af86914d649d4cd88a7366c0693ab438"}]}] Oct 28 09:54:03.614828 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Tenant: tempest-VolumesNegativeTest-12972343 Oct 28 09:54:03.614828 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Tenant-Id: af86914d649d4cd88a7366c0693ab438 Oct 28 09:54:03.614828 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Tenant-Name: tempest-VolumesNegativeTest-12972343 Oct 28 09:54:03.614828 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User: tempest-VolumesNegativeTest-12972343-project Oct 28 09:54:03.614828 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User-Domain-Id: default Oct 28 09:54:03.614828 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User-Domain-Name: Default Oct 28 09:54:03.614828 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User-Id: 27d120bc73eb4bbea72153707d6e5caa Oct 28 09:54:03.614828 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User-Name: tempest-VolumesNegativeTest-12972343-project Oct 28 09:54:03.614828 dv-cinder-zed-3-smb devstack@n-api.service[127033]: method: Oct 28 09:54:03.614828 dv-cinder-zed-3-smb devstack@n-api.service[127033]: exception: Volume 17028d75-3632-4b75-9e3d-77b5f0c15071 could not be found. Oct 28 09:54:03.614828 dv-cinder-zed-3-smb devstack@n-api.service[127033]: action_args: {'id': '17028d75-3632-4b75-9e3d-77b5f0c15071'} Oct 28 09:54:03.614828 dv-cinder-zed-3-smb devstack@n-api.service[127033]: {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:54:03.615809 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:54:03.615809 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 28 09:54:03.615809 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 28 09:54:03.615809 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 28 09:54:03.615809 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 28 09:54:03.615809 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 28 09:54:03.615809 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 28 09:54:03.615809 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 28 09:54:03.615809 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 28 09:54:03.615809 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 28 09:54:03.615809 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 28 09:54:03.615809 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 28 09:54:03.615809 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 28 09:54:03.615809 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 28 09:54:03.615809 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 28 09:54:03.615809 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 17028d75-3632-4b75-9e3d-77b5f0c15071 could not be found. (HTTP 404) (Request-ID: req-757b942b-ee32-4751-8ca7-32203add1e54) Oct 28 09:54:03.615809 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:54:03.615809 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:54:03.615809 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:54:03.617211 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:54:03.617211 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 28 09:54:03.617211 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 28 09:54:03.617211 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 28 09:54:03.617211 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 28 09:54:03.617211 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 28 09:54:03.617211 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 28 09:54:03.617211 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 28 09:54:03.617211 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 28 09:54:03.617211 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 28 09:54:03.617211 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 28 09:54:03.617211 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 28 09:54:03.617211 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 28 09:54:03.617211 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 28 09:54:03.617211 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 28 09:54:03.617211 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 28 09:54:03.617211 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 28 09:54:03.617211 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 28 09:54:03.617211 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 28 09:54:03.618345 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 28 09:54:03.618345 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 28 09:54:03.618345 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 28 09:54:03.618345 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 28 09:54:03.618345 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 17028d75-3632-4b75-9e3d-77b5f0c15071 could not be found. Oct 28 09:54:03.618345 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:54:03.618345 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:54:03.618345 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:54:03.618345 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:54:03.618345 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:54:03.618345 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:54:03.618345 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:54:03.618345 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:54:03.618345 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 09:54:03.618345 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 09:54:03.618345 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:54:03.618345 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:54:03.618345 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 28 09:54:03.618345 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 09:54:03.619456 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 17028d75-3632-4b75-9e3d-77b5f0c15071 could not be found. Oct 28 09:54:03.619456 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:54:03.619456 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:54:03.619456 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:54:03.619456 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:54:03.619456 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:54:03.619456 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:54:03.619456 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:54:03.619456 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:54:03.619456 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 17028d75-3632-4b75-9e3d-77b5f0c15071 could not be found. Oct 28 09:54:03.619456 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:54:03.619456 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-1fa312c9-39ac-4a67-ac73-76db097288d3 tempest-VolumesNegativeTest-12972343 tempest-VolumesNegativeTest-12972343-project] Returning 404 to user: Volume 17028d75-3632-4b75-9e3d-77b5f0c15071 could not be found. {{(pid=127033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:54:03.619456 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-1fa312c9-39ac-4a67-ac73-76db097288d3 tempest-VolumesNegativeTest-12972343 tempest-VolumesNegativeTest-12972343-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/17028d75-3632-4b75-9e3d-77b5f0c15071" status: 404 len: 109 microversion: 2.1 time: 0.041653 Oct 28 09:54:03.619456 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 386/787] 10.222.0.52 () {58 vars in 1248 bytes} [Fri Oct 28 09:54:03 2022] DELETE /compute/v2.1/os-volumes/17028d75-3632-4b75-9e3d-77b5f0c15071 => generated 109 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:54:03.625866 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-ff954109-579e-45dc-82fe-67e08a0ea0d9 tempest-VolumesNegativeTest-12972343 tempest-VolumesNegativeTest-12972343-project] Calling method '.version_select at 0x7ff0102b8040>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:03.655060 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.wsgi [None req-ff954109-579e-45dc-82fe-67e08a0ea0d9 tempest-VolumesNegativeTest-12972343 tempest-VolumesNegativeTest-12972343-project] HTTP exception thrown: Volume 3345a577-ed05-47e9-ac0d-e757e7591a28 could not be found. Oct 28 09:54:03.657055 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-ff954109-579e-45dc-82fe-67e08a0ea0d9 tempest-VolumesNegativeTest-12972343 tempest-VolumesNegativeTest-12972343-project] Request method failure captured: Oct 28 09:54:03.657055 dv-cinder-zed-3-smb devstack@n-api.service[127032]: request: GET /compute/v2.1/os-volumes/3345a577-ed05-47e9-ac0d-e757e7591a28 HTTP/1.1 Oct 28 09:54:03.657055 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Accept: application/json Oct 28 09:54:03.657055 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Accept-Encoding: identity Oct 28 09:54:03.657055 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Connection: close Oct 28 09:54:03.657055 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Content-Length: 0 Oct 28 09:54:03.657055 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Content-Type: application/json Oct 28 09:54:03.657055 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Host: 10.222.0.52 Oct 28 09:54:03.657055 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Openstack-System-Scope: None Oct 28 09:54:03.657055 dv-cinder-zed-3-smb devstack@n-api.service[127032]: User-Agent: python-urllib3/1.26.12 Oct 28 09:54:03.657055 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Auth-Token: gAAAAABjW6a7OQQb4c2HiMw6iebLfi47MjQCloPweO1B7hvQy9QT0I67pgZ7s1cw0BMevB9NP9l-6m_JgG3jsd_tDh0DcVDD0vCo_j1I9Y_aRpL2p6xlIIH0OkSI9xGJZ8mBXqTPbiPH3hqgLtlKdMYV_7ACEZF54yO1SjyQ0tkRwm7u8w597-g Oct 28 09:54:03.657055 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Domain-Id: None Oct 28 09:54:03.657055 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Domain-Name: None Oct 28 09:54:03.657055 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Identity-Status: Confirmed Oct 28 09:54:03.657055 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Is-Admin-Project: True Oct 28 09:54:03.657055 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Project-Domain-Id: default Oct 28 09:54:03.657055 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Project-Domain-Name: Default Oct 28 09:54:03.657055 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Project-Id: af86914d649d4cd88a7366c0693ab438 Oct 28 09:54:03.657055 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Project-Name: tempest-VolumesNegativeTest-12972343 Oct 28 09:54:03.657055 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Role: reader,member Oct 28 09:54:03.657055 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Roles: reader,member Oct 28 09:54:03.658651 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_af86914d649d4cd88a7366c0693ab438"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/af86914d649d4cd88a7366c0693ab438"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/af86914d649d4cd88a7366c0693ab438"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/af86914d649d4cd88a7366c0693ab438"}]}] Oct 28 09:54:03.658651 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Tenant: tempest-VolumesNegativeTest-12972343 Oct 28 09:54:03.658651 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Tenant-Id: af86914d649d4cd88a7366c0693ab438 Oct 28 09:54:03.658651 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Tenant-Name: tempest-VolumesNegativeTest-12972343 Oct 28 09:54:03.658651 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-User: tempest-VolumesNegativeTest-12972343-project Oct 28 09:54:03.658651 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-User-Domain-Id: default Oct 28 09:54:03.658651 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-User-Domain-Name: Default Oct 28 09:54:03.658651 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-User-Id: 27d120bc73eb4bbea72153707d6e5caa Oct 28 09:54:03.658651 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-User-Name: tempest-VolumesNegativeTest-12972343-project Oct 28 09:54:03.658651 dv-cinder-zed-3-smb devstack@n-api.service[127032]: method: Oct 28 09:54:03.658651 dv-cinder-zed-3-smb devstack@n-api.service[127032]: exception: Volume 3345a577-ed05-47e9-ac0d-e757e7591a28 could not be found. Oct 28 09:54:03.658651 dv-cinder-zed-3-smb devstack@n-api.service[127032]: action_args: {'id': '3345a577-ed05-47e9-ac0d-e757e7591a28'} Oct 28 09:54:03.658651 dv-cinder-zed-3-smb devstack@n-api.service[127032]: {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:54:03.660423 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:54:03.660423 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 28 09:54:03.660423 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 28 09:54:03.660423 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 28 09:54:03.660423 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 28 09:54:03.660423 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 28 09:54:03.660423 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 28 09:54:03.660423 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 28 09:54:03.660423 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 28 09:54:03.660423 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 28 09:54:03.660423 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 28 09:54:03.660423 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 28 09:54:03.660423 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 28 09:54:03.660423 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 28 09:54:03.660423 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 28 09:54:03.660423 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3345a577-ed05-47e9-ac0d-e757e7591a28 could not be found. (HTTP 404) (Request-ID: req-553af304-f399-4836-a15e-ac3341858ace) Oct 28 09:54:03.660423 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Oct 28 09:54:03.660423 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:54:03.660423 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Oct 28 09:54:03.661558 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:54:03.661558 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 28 09:54:03.661558 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 28 09:54:03.661558 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 28 09:54:03.661558 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 28 09:54:03.661558 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 28 09:54:03.661558 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 28 09:54:03.661558 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 28 09:54:03.661558 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 28 09:54:03.661558 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 28 09:54:03.661558 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 28 09:54:03.661558 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 28 09:54:03.661558 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 28 09:54:03.661558 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 28 09:54:03.661558 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 28 09:54:03.661558 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 28 09:54:03.661558 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 28 09:54:03.661558 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 28 09:54:03.661558 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 28 09:54:03.662641 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 28 09:54:03.662641 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 28 09:54:03.662641 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 28 09:54:03.662641 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 28 09:54:03.662641 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3345a577-ed05-47e9-ac0d-e757e7591a28 could not be found. Oct 28 09:54:03.662641 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Oct 28 09:54:03.662641 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:54:03.662641 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Oct 28 09:54:03.662641 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:54:03.662641 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:54:03.662641 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:54:03.662641 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:54:03.662641 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:54:03.662641 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 09:54:03.662641 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 09:54:03.662641 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:54:03.662641 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:54:03.662641 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 28 09:54:03.662641 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 09:54:03.663771 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3345a577-ed05-47e9-ac0d-e757e7591a28 could not be found. Oct 28 09:54:03.663771 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Oct 28 09:54:03.663771 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:54:03.663771 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Oct 28 09:54:03.663771 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:54:03.663771 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:54:03.663771 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:54:03.663771 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:54:03.663771 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:54:03.663771 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3345a577-ed05-47e9-ac0d-e757e7591a28 could not be found. Oct 28 09:54:03.663771 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Oct 28 09:54:03.663771 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-ff954109-579e-45dc-82fe-67e08a0ea0d9 tempest-VolumesNegativeTest-12972343 tempest-VolumesNegativeTest-12972343-project] Returning 404 to user: Volume 3345a577-ed05-47e9-ac0d-e757e7591a28 could not be found. {{(pid=127032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:54:03.663771 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-ff954109-579e-45dc-82fe-67e08a0ea0d9 tempest-VolumesNegativeTest-12972343 tempest-VolumesNegativeTest-12972343-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/3345a577-ed05-47e9-ac0d-e757e7591a28" status: 404 len: 109 microversion: 2.1 time: 0.037559 Oct 28 09:54:03.663771 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 402/788] 10.222.0.52 () {58 vars in 1245 bytes} [Fri Oct 28 09:54:03 2022] GET /compute/v2.1/os-volumes/3345a577-ed05-47e9-ac0d-e757e7591a28 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:54:10.653423 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG dbcounter [-] [127033] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=127033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:54:10.654736 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG dbcounter [-] [127033] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=86,nova_cell1:INSERT=2 {{(pid=127033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:54:10.659571 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-0f46167f-8835-44f7-aa5d-8351420e6fe1 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:10.660096 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-0f46167f-8835-44f7-aa5d-8351420e6fe1 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] [instance: 239cbe4b-b0d1-4361-80af-f3015cb39176] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:10.667760 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-0f46167f-8835-44f7-aa5d-8351420e6fe1 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:10.668333 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-0f46167f-8835-44f7-aa5d-8351420e6fe1 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:10.668670 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-0f46167f-8835-44f7-aa5d-8351420e6fe1 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:10.669376 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-0f46167f-8835-44f7-aa5d-8351420e6fe1 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:10.669833 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-0f46167f-8835-44f7-aa5d-8351420e6fe1 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:10.670759 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-0f46167f-8835-44f7-aa5d-8351420e6fe1 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:10.696678 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-0f46167f-8835-44f7-aa5d-8351420e6fe1 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] 10.222.0.52 "GET /compute/v2.1/servers/239cbe4b-b0d1-4361-80af-f3015cb39176/ips" status: 200 len: 150 microversion: 2.1 time: 0.044587 Oct 28 09:54:10.698120 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 387/789] 10.222.0.52 () {58 vars in 1248 bytes} [Fri Oct 28 09:54:10 2022] GET /compute/v2.1/servers/239cbe4b-b0d1-4361-80af-f3015cb39176/ips => generated 150 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:54:12.137029 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG dbcounter [-] [127032] Writing DB stats nova_api:SELECT=26,nova_api:DELETE=1 {{(pid=127032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:54:12.137865 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG dbcounter [-] [127032] Writing DB stats nova_cell1:SELECT=40,nova_cell1:INSERT=2 {{(pid=127032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:54:12.142733 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-809729b2-e661-4187-8531-b07ee15760ba tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "95ee2c9f-876a-4f48-a969-8347aaa671bb"}} {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:54:12.145249 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-809729b2-e661-4187-8531-b07ee15760ba tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] [instance: 239cbe4b-b0d1-4361-80af-f3015cb39176] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:12.153611 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-809729b2-e661-4187-8531-b07ee15760ba tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:12.154105 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-809729b2-e661-4187-8531-b07ee15760ba tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:12.154762 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-809729b2-e661-4187-8531-b07ee15760ba tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:12.155476 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-809729b2-e661-4187-8531-b07ee15760ba tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:12.155957 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-809729b2-e661-4187-8531-b07ee15760ba tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:12.156380 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-809729b2-e661-4187-8531-b07ee15760ba tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:12.480717 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-809729b2-e661-4187-8531-b07ee15760ba tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] 10.222.0.52 "POST /compute/v2.1/servers/239cbe4b-b0d1-4361-80af-f3015cb39176/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.344747 Oct 28 09:54:12.481326 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 403/790] 10.222.0.52 () {60 vars in 1323 bytes} [Fri Oct 28 09:54:12 2022] POST /compute/v2.1/servers/239cbe4b-b0d1-4361-80af-f3015cb39176/os-volume_attachments => generated 194 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:54:14.753706 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-92f3a891-16f2-43cc-b427-1214063bd5f7 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Action: 'create', calling method: .version_select at 0x7ff0101098b0>, body: {"keypair": {"name": "tempest-keypair-619236742", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI7F2kAxAJlyXau7tr6mqkvA+gc1utaDGQQgyZJoTEgRax8pLiPpT3fQsal0ezhOB6r7txq16fma8SPkMZ7cTVR3uf3md7mcMbogAgl+m2L8ZMdr3Jn+YjN6NAraD67fqw=="}} {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:54:14.769931 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.quota [None req-92f3a891-16f2-43cc-b427-1214063bd5f7 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Getting quotas for project 68e60d7c624e49e1bb43188ae9d7dd2b. Resources: {'key_pairs'} {{(pid=127033) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 09:54:14.773892 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.quota [None req-92f3a891-16f2-43cc-b427-1214063bd5f7 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Getting quotas for user d38ce75423b5412d90c1158396978b97 and project 68e60d7c624e49e1bb43188ae9d7dd2b. Resources: {'key_pairs'} {{(pid=127033) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 09:54:14.797294 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-92f3a891-16f2-43cc-b427-1214063bd5f7 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.046875 Oct 28 09:54:14.797901 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 388/791] 10.222.0.52 () {60 vars in 1159 bytes} [Fri Oct 28 09:54:14 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:54:16.317388 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-416aff77-aca4-4acc-84c8-02dc121988ee tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1306028105", "imageRef": "6e314146-a2ed-4f8b-afdd-4f7ed1184d20", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a8c5bacf-14eb-40aa-b7c5-10fa69559527"}], "security_groups": [{"name": "tempest-securitygroup--1950572737"}], "key_name": "tempest-keypair-619236742", "user_data": "}} {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:54:16.427102 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.network.neutron [None req-416aff77-aca4-4acc-84c8-02dc121988ee tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] validate_networks() for [('a8c5bacf-14eb-40aa-b7c5-10fa69559527', None, None, None, None, None)] {{(pid=127032) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 09:54:16.876581 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.virt.hardware [None req-416aff77-aca4-4acc-84c8-02dc121988ee tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Flavor limits 0:0:0 {{(pid=127032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 09:54:16.877088 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.virt.hardware [None req-416aff77-aca4-4acc-84c8-02dc121988ee tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Image limits 0:0:0 {{(pid=127032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 09:54:16.877629 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.virt.hardware [None req-416aff77-aca4-4acc-84c8-02dc121988ee tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Flavor pref 0:0:0 {{(pid=127032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 09:54:16.878105 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.virt.hardware [None req-416aff77-aca4-4acc-84c8-02dc121988ee tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Image pref 0:0:0 {{(pid=127032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 09:54:16.878585 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.virt.hardware [None req-416aff77-aca4-4acc-84c8-02dc121988ee tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 09:54:16.887295 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-416aff77-aca4-4acc-84c8-02dc121988ee tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:16.887801 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-416aff77-aca4-4acc-84c8-02dc121988ee tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:16.888235 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-416aff77-aca4-4acc-84c8-02dc121988ee tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:16.888955 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-416aff77-aca4-4acc-84c8-02dc121988ee tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:16.889407 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-416aff77-aca4-4acc-84c8-02dc121988ee tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:16.890621 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-416aff77-aca4-4acc-84c8-02dc121988ee tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:16.908865 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.quota [None req-416aff77-aca4-4acc-84c8-02dc121988ee tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Getting quotas for project 68e60d7c624e49e1bb43188ae9d7dd2b. Resources: {'cores', 'ram', 'instances'} {{(pid=127032) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 09:54:16.913343 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.quota [None req-416aff77-aca4-4acc-84c8-02dc121988ee tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Getting quotas for user d38ce75423b5412d90c1158396978b97 and project 68e60d7c624e49e1bb43188ae9d7dd2b. Resources: {'cores', 'ram', 'instances'} {{(pid=127032) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 09:54:16.926466 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-416aff77-aca4-4acc-84c8-02dc121988ee tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Going to run 1 instances... {{(pid=127032) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 09:54:16.929747 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-416aff77-aca4-4acc-84c8-02dc121988ee tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] [instance: 91ca6322-9cdc-4106-8021-811be2c4af7f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e314146-a2ed-4f8b-afdd-4f7ed1184d20',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127032) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 09:54:16.989450 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-416aff77-aca4-4acc-84c8-02dc121988ee tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.677387 Oct 28 09:54:16.990269 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 404/792] 10.222.0.52 () {60 vars in 1147 bytes} [Fri Oct 28 09:54:16 2022] POST /compute/v2.1/servers => generated 402 bytes in 679 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 09:54:17.004202 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-94d90362-b77b-4320-b117-90cae48079fc tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:17.004951 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-94d90362-b77b-4320-b117-90cae48079fc tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] [instance: 91ca6322-9cdc-4106-8021-811be2c4af7f] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:17.079875 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-94d90362-b77b-4320-b117-90cae48079fc tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38ce75423b5412d90c1158396978b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e60d7c624e49e1bb43188ae9d7dd2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:17.090937 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-94d90362-b77b-4320-b117-90cae48079fc tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] 10.222.0.52 "GET /compute/v2.1/servers/91ca6322-9cdc-4106-8021-811be2c4af7f" status: 200 len: 1241 microversion: 2.1 time: 0.092987 Oct 28 09:54:17.092608 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 389/793] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:54:16 2022] GET /compute/v2.1/servers/91ca6322-9cdc-4106-8021-811be2c4af7f => generated 1241 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:54:18.115617 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-ebdc13dc-f9c9-4dac-aa09-513b50bbca5d tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:18.116470 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-ebdc13dc-f9c9-4dac-aa09-513b50bbca5d tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] [instance: 91ca6322-9cdc-4106-8021-811be2c4af7f] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:18.125971 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ebdc13dc-f9c9-4dac-aa09-513b50bbca5d tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:18.126569 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ebdc13dc-f9c9-4dac-aa09-513b50bbca5d tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:18.127071 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ebdc13dc-f9c9-4dac-aa09-513b50bbca5d tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:18.127924 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ebdc13dc-f9c9-4dac-aa09-513b50bbca5d tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:18.128436 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ebdc13dc-f9c9-4dac-aa09-513b50bbca5d tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:18.129005 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ebdc13dc-f9c9-4dac-aa09-513b50bbca5d tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:18.194256 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-ebdc13dc-f9c9-4dac-aa09-513b50bbca5d tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38ce75423b5412d90c1158396978b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e60d7c624e49e1bb43188ae9d7dd2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:18.205260 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-ebdc13dc-f9c9-4dac-aa09-513b50bbca5d tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] 10.222.0.52 "GET /compute/v2.1/servers/91ca6322-9cdc-4106-8021-811be2c4af7f" status: 200 len: 1293 microversion: 2.1 time: 0.093796 Oct 28 09:54:18.206377 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 405/794] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:54:18 2022] GET /compute/v2.1/servers/91ca6322-9cdc-4106-8021-811be2c4af7f => generated 1293 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:54:19.232283 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-21f099ba-d8f0-4e15-894a-a1d66aaec18e tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:19.233744 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-21f099ba-d8f0-4e15-894a-a1d66aaec18e tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] [instance: 91ca6322-9cdc-4106-8021-811be2c4af7f] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:19.243919 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-21f099ba-d8f0-4e15-894a-a1d66aaec18e tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:19.244585 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-21f099ba-d8f0-4e15-894a-a1d66aaec18e tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:19.245182 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-21f099ba-d8f0-4e15-894a-a1d66aaec18e tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:19.249886 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-21f099ba-d8f0-4e15-894a-a1d66aaec18e tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:19.250611 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-21f099ba-d8f0-4e15-894a-a1d66aaec18e tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:19.252237 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-21f099ba-d8f0-4e15-894a-a1d66aaec18e tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:19.400703 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-21f099ba-d8f0-4e15-894a-a1d66aaec18e tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38ce75423b5412d90c1158396978b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e60d7c624e49e1bb43188ae9d7dd2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:19.409720 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-21f099ba-d8f0-4e15-894a-a1d66aaec18e tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] 10.222.0.52 "GET /compute/v2.1/servers/91ca6322-9cdc-4106-8021-811be2c4af7f" status: 200 len: 1367 microversion: 2.1 time: 0.184103 Oct 28 09:54:19.410577 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 390/795] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:54:19 2022] GET /compute/v2.1/servers/91ca6322-9cdc-4106-8021-811be2c4af7f => generated 1367 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:54:19.971791 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [req-4d60eb3c-5c7c-4856-a00d-116b0baa7312 req-64eca5fe-7500-41d0-ae8e-3cfd747e0fbe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91ca6322-9cdc-4106-8021-811be2c4af7f", "tag": "1cfbcd30-0147-4e20-82fe-3a1b33dcf67f"}]} {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:54:19.989191 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-4d60eb3c-5c7c-4856-a00d-116b0baa7312 req-64eca5fe-7500-41d0-ae8e-3cfd747e0fbe service nova] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:19.989966 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-4d60eb3c-5c7c-4856-a00d-116b0baa7312 req-64eca5fe-7500-41d0-ae8e-3cfd747e0fbe service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:19.990406 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-4d60eb3c-5c7c-4856-a00d-116b0baa7312 req-64eca5fe-7500-41d0-ae8e-3cfd747e0fbe service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:20.003084 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.compute.server_external_events [req-4d60eb3c-5c7c-4856-a00d-116b0baa7312 req-64eca5fe-7500-41d0-ae8e-3cfd747e0fbe service nova] Creating event network-changed:1cfbcd30-0147-4e20-82fe-3a1b33dcf67f for instance 91ca6322-9cdc-4106-8021-811be2c4af7f on hv-cinder-zed-3 Oct 28 09:54:20.008119 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [req-4d60eb3c-5c7c-4856-a00d-116b0baa7312 req-64eca5fe-7500-41d0-ae8e-3cfd747e0fbe service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039985 Oct 28 09:54:20.008729 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 406/796] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Oct 28 09:54:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 09:54:20.434107 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-cc762131-82b8-4466-9027-0b3950715f3b tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:20.434951 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-cc762131-82b8-4466-9027-0b3950715f3b tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] [instance: 91ca6322-9cdc-4106-8021-811be2c4af7f] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:20.443161 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-cc762131-82b8-4466-9027-0b3950715f3b tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:20.443858 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-cc762131-82b8-4466-9027-0b3950715f3b tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:20.444362 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-cc762131-82b8-4466-9027-0b3950715f3b tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:20.445075 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-cc762131-82b8-4466-9027-0b3950715f3b tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:20.445724 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-cc762131-82b8-4466-9027-0b3950715f3b tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:20.446316 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-cc762131-82b8-4466-9027-0b3950715f3b tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:20.597272 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-cc762131-82b8-4466-9027-0b3950715f3b tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38ce75423b5412d90c1158396978b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e60d7c624e49e1bb43188ae9d7dd2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:20.605287 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-cc762131-82b8-4466-9027-0b3950715f3b tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] 10.222.0.52 "GET /compute/v2.1/servers/91ca6322-9cdc-4106-8021-811be2c4af7f" status: 200 len: 1367 microversion: 2.1 time: 0.175063 Oct 28 09:54:20.605853 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 391/797] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:54:20 2022] GET /compute/v2.1/servers/91ca6322-9cdc-4106-8021-811be2c4af7f => generated 1367 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:54:21.631423 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-b1a9bbcd-72a0-48e8-a7a7-8e7d2e256572 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:21.632240 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-b1a9bbcd-72a0-48e8-a7a7-8e7d2e256572 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] [instance: 91ca6322-9cdc-4106-8021-811be2c4af7f] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:21.638449 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-b1a9bbcd-72a0-48e8-a7a7-8e7d2e256572 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:21.638927 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-b1a9bbcd-72a0-48e8-a7a7-8e7d2e256572 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:21.639358 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-b1a9bbcd-72a0-48e8-a7a7-8e7d2e256572 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:21.640080 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-b1a9bbcd-72a0-48e8-a7a7-8e7d2e256572 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:21.641168 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-b1a9bbcd-72a0-48e8-a7a7-8e7d2e256572 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:21.641586 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-b1a9bbcd-72a0-48e8-a7a7-8e7d2e256572 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:21.773607 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-b1a9bbcd-72a0-48e8-a7a7-8e7d2e256572 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38ce75423b5412d90c1158396978b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e60d7c624e49e1bb43188ae9d7dd2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:21.782369 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-b1a9bbcd-72a0-48e8-a7a7-8e7d2e256572 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] 10.222.0.52 "GET /compute/v2.1/servers/91ca6322-9cdc-4106-8021-811be2c4af7f" status: 200 len: 1367 microversion: 2.1 time: 0.156678 Oct 28 09:54:21.783030 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 407/798] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:54:21 2022] GET /compute/v2.1/servers/91ca6322-9cdc-4106-8021-811be2c4af7f => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:54:22.805580 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-8f22ad6c-e6c5-4b21-8710-95a5740e2956 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:22.806196 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-8f22ad6c-e6c5-4b21-8710-95a5740e2956 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] [instance: 91ca6322-9cdc-4106-8021-811be2c4af7f] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:22.812761 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-8f22ad6c-e6c5-4b21-8710-95a5740e2956 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:22.813242 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-8f22ad6c-e6c5-4b21-8710-95a5740e2956 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:22.813674 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-8f22ad6c-e6c5-4b21-8710-95a5740e2956 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:22.814355 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-8f22ad6c-e6c5-4b21-8710-95a5740e2956 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:22.814807 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-8f22ad6c-e6c5-4b21-8710-95a5740e2956 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:22.815226 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-8f22ad6c-e6c5-4b21-8710-95a5740e2956 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:22.945540 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-8f22ad6c-e6c5-4b21-8710-95a5740e2956 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38ce75423b5412d90c1158396978b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e60d7c624e49e1bb43188ae9d7dd2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:22.953815 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-8f22ad6c-e6c5-4b21-8710-95a5740e2956 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] 10.222.0.52 "GET /compute/v2.1/servers/91ca6322-9cdc-4106-8021-811be2c4af7f" status: 200 len: 1367 microversion: 2.1 time: 0.152072 Oct 28 09:54:22.954378 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 392/799] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:54:22 2022] GET /compute/v2.1/servers/91ca6322-9cdc-4106-8021-811be2c4af7f => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:54:23.976490 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-cd66c14b-fb67-4833-b6cf-4b252bbc337c tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:23.977103 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-cd66c14b-fb67-4833-b6cf-4b252bbc337c tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] [instance: 91ca6322-9cdc-4106-8021-811be2c4af7f] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:23.983705 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-cd66c14b-fb67-4833-b6cf-4b252bbc337c tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:23.984223 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-cd66c14b-fb67-4833-b6cf-4b252bbc337c tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:23.984659 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-cd66c14b-fb67-4833-b6cf-4b252bbc337c tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:23.985351 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-cd66c14b-fb67-4833-b6cf-4b252bbc337c tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:23.985805 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-cd66c14b-fb67-4833-b6cf-4b252bbc337c tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:23.986229 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-cd66c14b-fb67-4833-b6cf-4b252bbc337c tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:24.120966 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-cd66c14b-fb67-4833-b6cf-4b252bbc337c tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38ce75423b5412d90c1158396978b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e60d7c624e49e1bb43188ae9d7dd2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:24.129454 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-cd66c14b-fb67-4833-b6cf-4b252bbc337c tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] 10.222.0.52 "GET /compute/v2.1/servers/91ca6322-9cdc-4106-8021-811be2c4af7f" status: 200 len: 1367 microversion: 2.1 time: 0.156784 Oct 28 09:54:24.130024 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 408/800] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:54:23 2022] GET /compute/v2.1/servers/91ca6322-9cdc-4106-8021-811be2c4af7f => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:54:25.153061 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-17057b62-3e4f-400b-8211-075d4ae853be tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:25.154189 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-17057b62-3e4f-400b-8211-075d4ae853be tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] [instance: 91ca6322-9cdc-4106-8021-811be2c4af7f] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:25.161417 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-17057b62-3e4f-400b-8211-075d4ae853be tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:25.161992 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-17057b62-3e4f-400b-8211-075d4ae853be tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:25.162649 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-17057b62-3e4f-400b-8211-075d4ae853be tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:25.163677 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-17057b62-3e4f-400b-8211-075d4ae853be tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:25.164241 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-17057b62-3e4f-400b-8211-075d4ae853be tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:25.164931 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-17057b62-3e4f-400b-8211-075d4ae853be tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:25.299639 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-17057b62-3e4f-400b-8211-075d4ae853be tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38ce75423b5412d90c1158396978b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e60d7c624e49e1bb43188ae9d7dd2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:25.307249 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-17057b62-3e4f-400b-8211-075d4ae853be tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] 10.222.0.52 "GET /compute/v2.1/servers/91ca6322-9cdc-4106-8021-811be2c4af7f" status: 200 len: 1367 microversion: 2.1 time: 0.158661 Oct 28 09:54:25.307862 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 393/801] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:54:25 2022] GET /compute/v2.1/servers/91ca6322-9cdc-4106-8021-811be2c4af7f => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:54:26.329566 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-a80bacd7-f333-4c65-8fff-72dbef99e9d2 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:26.330164 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-a80bacd7-f333-4c65-8fff-72dbef99e9d2 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] [instance: 91ca6322-9cdc-4106-8021-811be2c4af7f] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:26.336579 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-a80bacd7-f333-4c65-8fff-72dbef99e9d2 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:26.337067 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-a80bacd7-f333-4c65-8fff-72dbef99e9d2 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:26.337537 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-a80bacd7-f333-4c65-8fff-72dbef99e9d2 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:26.338229 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-a80bacd7-f333-4c65-8fff-72dbef99e9d2 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:26.338689 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-a80bacd7-f333-4c65-8fff-72dbef99e9d2 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:26.339111 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-a80bacd7-f333-4c65-8fff-72dbef99e9d2 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:26.473155 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-a80bacd7-f333-4c65-8fff-72dbef99e9d2 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38ce75423b5412d90c1158396978b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e60d7c624e49e1bb43188ae9d7dd2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:26.481013 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-a80bacd7-f333-4c65-8fff-72dbef99e9d2 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] 10.222.0.52 "GET /compute/v2.1/servers/91ca6322-9cdc-4106-8021-811be2c4af7f" status: 200 len: 1367 microversion: 2.1 time: 0.155437 Oct 28 09:54:26.481575 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 409/802] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:54:26 2022] GET /compute/v2.1/servers/91ca6322-9cdc-4106-8021-811be2c4af7f => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:54:26.706413 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [req-04f56ca2-8505-418b-8daf-e5a70cc8f76a req-76cf6961-d5eb-4be2-a56f-df4af5b800c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91ca6322-9cdc-4106-8021-811be2c4af7f", "name": "network-vif-plugged", "status": "completed", "tag": "1cfbcd30-0147-4e20-82fe-3a1b33dcf67f"}]} {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:54:26.716300 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-04f56ca2-8505-418b-8daf-e5a70cc8f76a req-76cf6961-d5eb-4be2-a56f-df4af5b800c9 service nova] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:26.716799 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-04f56ca2-8505-418b-8daf-e5a70cc8f76a req-76cf6961-d5eb-4be2-a56f-df4af5b800c9 service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:26.717207 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-04f56ca2-8505-418b-8daf-e5a70cc8f76a req-76cf6961-d5eb-4be2-a56f-df4af5b800c9 service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:26.729335 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.compute.server_external_events [req-04f56ca2-8505-418b-8daf-e5a70cc8f76a req-76cf6961-d5eb-4be2-a56f-df4af5b800c9 service nova] Creating event network-vif-plugged:1cfbcd30-0147-4e20-82fe-3a1b33dcf67f for instance 91ca6322-9cdc-4106-8021-811be2c4af7f on hv-cinder-zed-3 Oct 28 09:54:26.734913 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [req-04f56ca2-8505-418b-8daf-e5a70cc8f76a req-76cf6961-d5eb-4be2-a56f-df4af5b800c9 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031636 Oct 28 09:54:26.735668 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 394/803] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Oct 28 09:54:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:54:27.504574 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-125259f8-c773-4927-a08d-8c283b0a940a tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:27.505250 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-125259f8-c773-4927-a08d-8c283b0a940a tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] [instance: 91ca6322-9cdc-4106-8021-811be2c4af7f] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:27.508234 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG dbcounter [-] [127032] Writing DB stats nova_cell0:SELECT=2 {{(pid=127032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:54:27.508886 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG dbcounter [-] [127032] Writing DB stats nova_cell0:SELECT=6 {{(pid=127032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:54:27.513898 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-125259f8-c773-4927-a08d-8c283b0a940a tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:27.514375 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-125259f8-c773-4927-a08d-8c283b0a940a tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:27.514802 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-125259f8-c773-4927-a08d-8c283b0a940a tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:27.515523 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-125259f8-c773-4927-a08d-8c283b0a940a tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:27.515996 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-125259f8-c773-4927-a08d-8c283b0a940a tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:27.516414 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-125259f8-c773-4927-a08d-8c283b0a940a tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:27.651195 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-125259f8-c773-4927-a08d-8c283b0a940a tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38ce75423b5412d90c1158396978b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e60d7c624e49e1bb43188ae9d7dd2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:27.659693 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-125259f8-c773-4927-a08d-8c283b0a940a tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] 10.222.0.52 "GET /compute/v2.1/servers/91ca6322-9cdc-4106-8021-811be2c4af7f" status: 200 len: 1367 microversion: 2.1 time: 0.158950 Oct 28 09:54:27.660314 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 410/804] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:54:27 2022] GET /compute/v2.1/servers/91ca6322-9cdc-4106-8021-811be2c4af7f => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:54:28.679617 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG dbcounter [-] [127033] Writing DB stats nova_cell0:SELECT=6 {{(pid=127033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:54:28.684827 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-03fc2a43-307a-40fc-8428-6654dc389fae tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:28.685551 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-03fc2a43-307a-40fc-8428-6654dc389fae tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] [instance: 91ca6322-9cdc-4106-8021-811be2c4af7f] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:28.692156 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-03fc2a43-307a-40fc-8428-6654dc389fae tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:28.692566 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-03fc2a43-307a-40fc-8428-6654dc389fae tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:28.692995 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-03fc2a43-307a-40fc-8428-6654dc389fae tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:28.693662 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-03fc2a43-307a-40fc-8428-6654dc389fae tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:28.694107 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-03fc2a43-307a-40fc-8428-6654dc389fae tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:28.694813 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-03fc2a43-307a-40fc-8428-6654dc389fae tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:28.835512 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-03fc2a43-307a-40fc-8428-6654dc389fae tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38ce75423b5412d90c1158396978b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e60d7c624e49e1bb43188ae9d7dd2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:28.845723 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-03fc2a43-307a-40fc-8428-6654dc389fae tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] 10.222.0.52 "GET /compute/v2.1/servers/91ca6322-9cdc-4106-8021-811be2c4af7f" status: 200 len: 1367 microversion: 2.1 time: 0.166977 Oct 28 09:54:28.846409 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 395/805] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:54:28 2022] GET /compute/v2.1/servers/91ca6322-9cdc-4106-8021-811be2c4af7f => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:54:29.869151 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-401eb556-f660-4928-9af4-351abdcf92e0 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:29.869887 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-401eb556-f660-4928-9af4-351abdcf92e0 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] [instance: 91ca6322-9cdc-4106-8021-811be2c4af7f] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:29.876573 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-401eb556-f660-4928-9af4-351abdcf92e0 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:29.877053 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-401eb556-f660-4928-9af4-351abdcf92e0 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:29.877480 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-401eb556-f660-4928-9af4-351abdcf92e0 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:29.878495 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-401eb556-f660-4928-9af4-351abdcf92e0 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:29.879271 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-401eb556-f660-4928-9af4-351abdcf92e0 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:29.879394 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-401eb556-f660-4928-9af4-351abdcf92e0 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:30.027489 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-401eb556-f660-4928-9af4-351abdcf92e0 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38ce75423b5412d90c1158396978b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e60d7c624e49e1bb43188ae9d7dd2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:30.036207 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-401eb556-f660-4928-9af4-351abdcf92e0 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] 10.222.0.52 "GET /compute/v2.1/servers/91ca6322-9cdc-4106-8021-811be2c4af7f" status: 200 len: 1557 microversion: 2.1 time: 0.171815 Oct 28 09:54:30.036820 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 411/806] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:54:29 2022] GET /compute/v2.1/servers/91ca6322-9cdc-4106-8021-811be2c4af7f => generated 1557 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:54:30.059282 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-92c4491c-3330-4d10-b68d-3c9989b02f35 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:30.059854 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-92c4491c-3330-4d10-b68d-3c9989b02f35 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] [instance: 91ca6322-9cdc-4106-8021-811be2c4af7f] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:30.066880 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-92c4491c-3330-4d10-b68d-3c9989b02f35 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:30.067291 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-92c4491c-3330-4d10-b68d-3c9989b02f35 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:30.067568 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-92c4491c-3330-4d10-b68d-3c9989b02f35 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:30.068304 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-92c4491c-3330-4d10-b68d-3c9989b02f35 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:30.068811 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-92c4491c-3330-4d10-b68d-3c9989b02f35 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:30.069174 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-92c4491c-3330-4d10-b68d-3c9989b02f35 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:30.149251 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-92c4491c-3330-4d10-b68d-3c9989b02f35 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] 10.222.0.52 "GET /compute/v2.1/servers/91ca6322-9cdc-4106-8021-811be2c4af7f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094179 Oct 28 09:54:30.149869 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 396/807] 10.222.0.52 () {58 vars in 1275 bytes} [Fri Oct 28 09:54:30 2022] GET /compute/v2.1/servers/91ca6322-9cdc-4106-8021-811be2c4af7f/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:54:31.337995 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [req-a2196752-31d1-4425-9586-648c4ec37670 req-0ee4cc99-35d6-4a2e-9f4b-52d0143987e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91ca6322-9cdc-4106-8021-811be2c4af7f", "tag": "1cfbcd30-0147-4e20-82fe-3a1b33dcf67f"}]} {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:54:31.348167 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-a2196752-31d1-4425-9586-648c4ec37670 req-0ee4cc99-35d6-4a2e-9f4b-52d0143987e1 service nova] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:31.348780 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-a2196752-31d1-4425-9586-648c4ec37670 req-0ee4cc99-35d6-4a2e-9f4b-52d0143987e1 service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:31.349429 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-a2196752-31d1-4425-9586-648c4ec37670 req-0ee4cc99-35d6-4a2e-9f4b-52d0143987e1 service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:31.361787 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.compute.server_external_events [req-a2196752-31d1-4425-9586-648c4ec37670 req-0ee4cc99-35d6-4a2e-9f4b-52d0143987e1 service nova] Creating event network-changed:1cfbcd30-0147-4e20-82fe-3a1b33dcf67f for instance 91ca6322-9cdc-4106-8021-811be2c4af7f on hv-cinder-zed-3 Oct 28 09:54:31.367208 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [req-a2196752-31d1-4425-9586-648c4ec37670 req-0ee4cc99-35d6-4a2e-9f4b-52d0143987e1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032641 Oct 28 09:54:31.367880 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 412/808] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Oct 28 09:54:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:54:49.399629 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG dbcounter [-] [127033] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=1 {{(pid=127033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:54:49.400336 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG dbcounter [-] [127033] Writing DB stats nova_cell1:SELECT=40 {{(pid=127033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:54:49.404336 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-5912cd93-1f4c-4c7c-beba-204df4a35820 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:49.406454 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-5912cd93-1f4c-4c7c-beba-204df4a35820 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 125194a5-e664-4ea8-ad7e-b0ae1b54e827] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:49.413987 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-5912cd93-1f4c-4c7c-beba-204df4a35820 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:49.414471 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-5912cd93-1f4c-4c7c-beba-204df4a35820 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:49.414903 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-5912cd93-1f4c-4c7c-beba-204df4a35820 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:49.415595 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-5912cd93-1f4c-4c7c-beba-204df4a35820 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:49.416084 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-5912cd93-1f4c-4c7c-beba-204df4a35820 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:49.416506 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-5912cd93-1f4c-4c7c-beba-204df4a35820 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:49.446402 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-5912cd93-1f4c-4c7c-beba-204df4a35820 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.048414 Oct 28 09:54:49.446958 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 397/809] 10.222.0.52 () {60 vars in 1343 bytes} [Fri Oct 28 09:54:49 2022] GET /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:54:49.516571 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-2cf4789d-aa6a-4431-ae19-d2ca38b91d9d tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:49.517303 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-2cf4789d-aa6a-4431-ae19-d2ca38b91d9d tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 125194a5-e664-4ea8-ad7e-b0ae1b54e827] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:49.519933 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG dbcounter [-] [127032] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=127032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:54:49.520579 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG dbcounter [-] [127032] Writing DB stats nova_cell1:SELECT=53,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:54:49.527965 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-2cf4789d-aa6a-4431-ae19-d2ca38b91d9d tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:49.528652 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-2cf4789d-aa6a-4431-ae19-d2ca38b91d9d tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:49.529089 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-2cf4789d-aa6a-4431-ae19-d2ca38b91d9d tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:49.529787 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-2cf4789d-aa6a-4431-ae19-d2ca38b91d9d tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:49.530246 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-2cf4789d-aa6a-4431-ae19-d2ca38b91d9d tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:49.530683 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-2cf4789d-aa6a-4431-ae19-d2ca38b91d9d tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:49.558390 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-2cf4789d-aa6a-4431-ae19-d2ca38b91d9d tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 125194a5-e664-4ea8-ad7e-b0ae1b54e827] Going to try to terminate instance {{(pid=127032) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 09:54:49.636061 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-2cf4789d-aa6a-4431-ae19-d2ca38b91d9d tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "DELETE /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827" status: 204 len: 0 microversion: 2.20 time: 0.123750 Oct 28 09:54:49.636948 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 413/810] 10.222.0.52 () {60 vars in 1280 bytes} [Fri Oct 28 09:54:49 2022] DELETE /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 09:54:49.646786 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-c53fccf8-5a86-4461-a8cf-9476dcdc1fdc tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:49.647428 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-c53fccf8-5a86-4461-a8cf-9476dcdc1fdc tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 125194a5-e664-4ea8-ad7e-b0ae1b54e827] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:49.653770 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-c53fccf8-5a86-4461-a8cf-9476dcdc1fdc tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:49.654191 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-c53fccf8-5a86-4461-a8cf-9476dcdc1fdc tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:49.654624 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-c53fccf8-5a86-4461-a8cf-9476dcdc1fdc tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:49.655321 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-c53fccf8-5a86-4461-a8cf-9476dcdc1fdc tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:49.655821 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-c53fccf8-5a86-4461-a8cf-9476dcdc1fdc tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:49.656234 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-c53fccf8-5a86-4461-a8cf-9476dcdc1fdc tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:49.799451 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-c53fccf8-5a86-4461-a8cf-9476dcdc1fdc tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:49.808255 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-c53fccf8-5a86-4461-a8cf-9476dcdc1fdc tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:49.809755 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-c53fccf8-5a86-4461-a8cf-9476dcdc1fdc tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:49.810911 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-c53fccf8-5a86-4461-a8cf-9476dcdc1fdc tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827" status: 200 len: 1721 microversion: 2.20 time: 0.168374 Oct 28 09:54:49.811526 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 398/811] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:54:49 2022] GET /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827 => generated 1721 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:54:50.837844 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-39467187-9747-4e26-8870-477214a3ddbe tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:50.838570 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-39467187-9747-4e26-8870-477214a3ddbe tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 125194a5-e664-4ea8-ad7e-b0ae1b54e827] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:50.845562 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-39467187-9747-4e26-8870-477214a3ddbe tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:50.846051 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-39467187-9747-4e26-8870-477214a3ddbe tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:50.846477 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-39467187-9747-4e26-8870-477214a3ddbe tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:50.847192 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-39467187-9747-4e26-8870-477214a3ddbe tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:50.847642 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-39467187-9747-4e26-8870-477214a3ddbe tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:50.848113 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-39467187-9747-4e26-8870-477214a3ddbe tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:51.183016 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-39467187-9747-4e26-8870-477214a3ddbe tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:51.193962 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-39467187-9747-4e26-8870-477214a3ddbe tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:51.195830 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-39467187-9747-4e26-8870-477214a3ddbe tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:51.197209 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-39467187-9747-4e26-8870-477214a3ddbe tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827" status: 200 len: 1721 microversion: 2.20 time: 0.363645 Oct 28 09:54:51.197766 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 414/812] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:54:50 2022] GET /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827 => generated 1721 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:54:52.186403 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [req-a54b9024-fb29-4b90-bed9-9dde47e6e95c req-2933a489-74bf-4be6-839c-9285d4ff7d13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "125194a5-e664-4ea8-ad7e-b0ae1b54e827", "name": "network-vif-deleted", "tag": "ff843068-026c-460b-ae99-a8c3ca1fb539"}]} {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:54:52.197785 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-a54b9024-fb29-4b90-bed9-9dde47e6e95c req-2933a489-74bf-4be6-839c-9285d4ff7d13 service nova] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:52.198264 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-a54b9024-fb29-4b90-bed9-9dde47e6e95c req-2933a489-74bf-4be6-839c-9285d4ff7d13 service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:52.198692 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-a54b9024-fb29-4b90-bed9-9dde47e6e95c req-2933a489-74bf-4be6-839c-9285d4ff7d13 service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:52.212215 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.compute.server_external_events [req-a54b9024-fb29-4b90-bed9-9dde47e6e95c req-2933a489-74bf-4be6-839c-9285d4ff7d13 service nova] Creating event network-vif-deleted:ff843068-026c-460b-ae99-a8c3ca1fb539 for instance 125194a5-e664-4ea8-ad7e-b0ae1b54e827 on hv-cinder-zed-3 Oct 28 09:54:52.218382 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [req-a54b9024-fb29-4b90-bed9-9dde47e6e95c req-2933a489-74bf-4be6-839c-9285d4ff7d13 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036065 Oct 28 09:54:52.218985 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 399/813] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Oct 28 09:54:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:54:52.222935 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-d798cdfe-88ce-42a1-a171-bef827c8bbfa tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:52.223548 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-d798cdfe-88ce-42a1-a171-bef827c8bbfa tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 125194a5-e664-4ea8-ad7e-b0ae1b54e827] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:52.230052 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-d798cdfe-88ce-42a1-a171-bef827c8bbfa tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:52.230536 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-d798cdfe-88ce-42a1-a171-bef827c8bbfa tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:52.230972 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-d798cdfe-88ce-42a1-a171-bef827c8bbfa tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:52.231659 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-d798cdfe-88ce-42a1-a171-bef827c8bbfa tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:52.232138 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-d798cdfe-88ce-42a1-a171-bef827c8bbfa tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:52.232557 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-d798cdfe-88ce-42a1-a171-bef827c8bbfa tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:52.558763 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-d798cdfe-88ce-42a1-a171-bef827c8bbfa tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:52.570172 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-d798cdfe-88ce-42a1-a171-bef827c8bbfa tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:52.572433 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-d798cdfe-88ce-42a1-a171-bef827c8bbfa tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdb5ce192c764fe4946542f5960ccd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500be47836b44a769f676e3e4bc00721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:52.573674 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-d798cdfe-88ce-42a1-a171-bef827c8bbfa tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827" status: 200 len: 1364 microversion: 2.20 time: 0.354569 Oct 28 09:54:52.574369 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 415/814] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:54:52 2022] GET /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827 => generated 1364 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:54:53.601030 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-f0bc4182-dd3b-463d-9768-71272e3fcbe7 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:53.601729 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-f0bc4182-dd3b-463d-9768-71272e3fcbe7 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 125194a5-e664-4ea8-ad7e-b0ae1b54e827] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:53.607942 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-f0bc4182-dd3b-463d-9768-71272e3fcbe7 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:53.608423 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-f0bc4182-dd3b-463d-9768-71272e3fcbe7 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:53.609162 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-f0bc4182-dd3b-463d-9768-71272e3fcbe7 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:53.610368 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-f0bc4182-dd3b-463d-9768-71272e3fcbe7 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:53.611041 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-f0bc4182-dd3b-463d-9768-71272e3fcbe7 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:53.611222 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-f0bc4182-dd3b-463d-9768-71272e3fcbe7 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:53.624773 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.wsgi [None req-f0bc4182-dd3b-463d-9768-71272e3fcbe7 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] HTTP exception thrown: Instance 125194a5-e664-4ea8-ad7e-b0ae1b54e827 could not be found. Oct 28 09:54:53.627093 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-f0bc4182-dd3b-463d-9768-71272e3fcbe7 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Request method failure captured: Oct 28 09:54:53.627093 dv-cinder-zed-3-smb devstack@n-api.service[127033]: request: GET /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827 HTTP/1.1 Oct 28 09:54:53.627093 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Accept: application/json Oct 28 09:54:53.627093 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Accept-Encoding: identity Oct 28 09:54:53.627093 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Connection: close Oct 28 09:54:53.627093 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Content-Length: 0 Oct 28 09:54:53.627093 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Content-Type: application/json Oct 28 09:54:53.627093 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Host: 10.222.0.52 Oct 28 09:54:53.627093 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Openstack-System-Scope: None Oct 28 09:54:53.627093 dv-cinder-zed-3-smb devstack@n-api.service[127033]: User-Agent: python-urllib3/1.26.12 Oct 28 09:54:53.627093 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Auth-Token: gAAAAABjW6TL-nfZoagrIIL_YkE36KuSDhOXjvGtC86ZbtDlieloNediNRa004asnIbmA7I1lf0tqGniDyzY5Jn6NbXRpQF0NeqHU8m8plx6SCWuxsy2RWYlws615e7915D0F4ZQ8NM-WziiWXtDE7IRn9CZQrYKNwQBHwYHsx6or-8Vv8tPJcE Oct 28 09:54:53.627093 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Domain-Id: None Oct 28 09:54:53.627093 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Domain-Name: None Oct 28 09:54:53.627093 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Identity-Status: Confirmed Oct 28 09:54:53.627093 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Is-Admin-Project: True Oct 28 09:54:53.627093 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Openstack-Nova-Api-Version: 2.20 Oct 28 09:54:53.627093 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Project-Domain-Id: default Oct 28 09:54:53.627093 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Project-Domain-Name: Default Oct 28 09:54:53.627093 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Project-Id: 500be47836b44a769f676e3e4bc00721 Oct 28 09:54:53.627093 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-146892991 Oct 28 09:54:53.627093 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Role: reader,member Oct 28 09:54:53.627093 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Roles: reader,member Oct 28 09:54:53.628830 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_500be47836b44a769f676e3e4bc00721"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/500be47836b44a769f676e3e4bc00721"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/500be47836b44a769f676e3e4bc00721"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/500be47836b44a769f676e3e4bc00721"}]}] Oct 28 09:54:53.628830 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Tenant: tempest-AttachVolumeShelveTestJSON-146892991 Oct 28 09:54:53.628830 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Tenant-Id: 500be47836b44a769f676e3e4bc00721 Oct 28 09:54:53.628830 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-146892991 Oct 28 09:54:53.628830 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User: tempest-AttachVolumeShelveTestJSON-146892991-project Oct 28 09:54:53.628830 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User-Domain-Id: default Oct 28 09:54:53.628830 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User-Domain-Name: Default Oct 28 09:54:53.628830 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User-Id: cdb5ce192c764fe4946542f5960ccd39 Oct 28 09:54:53.628830 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User-Name: tempest-AttachVolumeShelveTestJSON-146892991-project Oct 28 09:54:53.628830 dv-cinder-zed-3-smb devstack@n-api.service[127033]: method: > Oct 28 09:54:53.628830 dv-cinder-zed-3-smb devstack@n-api.service[127033]: exception: Instance 125194a5-e664-4ea8-ad7e-b0ae1b54e827 could not be found. Oct 28 09:54:53.628830 dv-cinder-zed-3-smb devstack@n-api.service[127033]: action_args: {'id': '125194a5-e664-4ea8-ad7e-b0ae1b54e827'} Oct 28 09:54:53.629694 dv-cinder-zed-3-smb devstack@n-api.service[127033]: {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:54:53.629694 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:54:53.629694 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 09:54:53.629694 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 09:54:53.629694 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 09:54:53.629694 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 09:54:53.629694 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 09:54:53.629694 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 09:54:53.629694 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 09:54:53.629694 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 09:54:53.629694 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 125194a5-e664-4ea8-ad7e-b0ae1b54e827 could not be found. Oct 28 09:54:53.629694 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:54:53.629694 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:54:53.629694 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:54:53.629694 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:54:53.629694 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:54:53.629694 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:54:53.629694 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:54:53.629694 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:54:53.629694 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:54:53.631287 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:54:53.631287 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 09:54:53.631287 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 09:54:53.631287 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 09:54:53.631287 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 09:54:53.631287 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 09:54:53.631287 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 09:54:53.631287 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 125194a5-e664-4ea8-ad7e-b0ae1b54e827 could not be found. Oct 28 09:54:53.631287 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:54:53.631287 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:54:53.631287 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:54:53.631287 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:54:53.631287 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:54:53.631287 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:54:53.631287 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:54:53.631287 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:54:53.631287 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 125194a5-e664-4ea8-ad7e-b0ae1b54e827 could not be found. Oct 28 09:54:53.631287 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:54:53.632674 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-f0bc4182-dd3b-463d-9768-71272e3fcbe7 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Returning 404 to user: Instance 125194a5-e664-4ea8-ad7e-b0ae1b54e827 could not be found. {{(pid=127033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:54:53.632674 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-f0bc4182-dd3b-463d-9768-71272e3fcbe7 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827" status: 404 len: 111 microversion: 2.20 time: 0.032117 Oct 28 09:54:53.632674 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 400/815] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:54:53 2022] GET /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 09:54:53.637965 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-031a71f6-4f44-4c40-acdf-6edb1e148618 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '.version_select at 0x7ff013ae0d30>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:53.659943 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-031a71f6-4f44-4c40-acdf-6edb1e148618 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-36306893" status: 204 len: 0 microversion: 2.20 time: 0.025982 Oct 28 09:54:53.660591 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 416/816] 10.222.0.52 () {60 vars in 1256 bytes} [Fri Oct 28 09:54:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-36306893 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 09:54:55.461713 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-aae889a0-d795-40a8-a394-c1ef7344be54 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:55.462213 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-aae889a0-d795-40a8-a394-c1ef7344be54 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 125194a5-e664-4ea8-ad7e-b0ae1b54e827] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:55.468612 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-aae889a0-d795-40a8-a394-c1ef7344be54 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:55.469640 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-aae889a0-d795-40a8-a394-c1ef7344be54 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:55.470072 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-aae889a0-d795-40a8-a394-c1ef7344be54 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:55.470763 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-aae889a0-d795-40a8-a394-c1ef7344be54 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:55.471210 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-aae889a0-d795-40a8-a394-c1ef7344be54 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:55.471635 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-aae889a0-d795-40a8-a394-c1ef7344be54 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:55.486384 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.wsgi [None req-aae889a0-d795-40a8-a394-c1ef7344be54 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] HTTP exception thrown: Instance 125194a5-e664-4ea8-ad7e-b0ae1b54e827 could not be found. Oct 28 09:54:55.487985 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-aae889a0-d795-40a8-a394-c1ef7344be54 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Request method failure captured: Oct 28 09:54:55.487985 dv-cinder-zed-3-smb devstack@n-api.service[127033]: request: DELETE /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827 HTTP/1.1 Oct 28 09:54:55.487985 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Accept: application/json Oct 28 09:54:55.487985 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Accept-Encoding: identity Oct 28 09:54:55.487985 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Connection: close Oct 28 09:54:55.487985 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Content-Length: 0 Oct 28 09:54:55.487985 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Content-Type: application/json Oct 28 09:54:55.487985 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Host: 10.222.0.52 Oct 28 09:54:55.487985 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Openstack-System-Scope: None Oct 28 09:54:55.487985 dv-cinder-zed-3-smb devstack@n-api.service[127033]: User-Agent: python-urllib3/1.26.12 Oct 28 09:54:55.487985 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Auth-Token: gAAAAABjW6TL-nfZoagrIIL_YkE36KuSDhOXjvGtC86ZbtDlieloNediNRa004asnIbmA7I1lf0tqGniDyzY5Jn6NbXRpQF0NeqHU8m8plx6SCWuxsy2RWYlws615e7915D0F4ZQ8NM-WziiWXtDE7IRn9CZQrYKNwQBHwYHsx6or-8Vv8tPJcE Oct 28 09:54:55.487985 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Domain-Id: None Oct 28 09:54:55.487985 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Domain-Name: None Oct 28 09:54:55.487985 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Identity-Status: Confirmed Oct 28 09:54:55.487985 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Is-Admin-Project: True Oct 28 09:54:55.487985 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Openstack-Nova-Api-Version: 2.20 Oct 28 09:54:55.487985 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Project-Domain-Id: default Oct 28 09:54:55.487985 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Project-Domain-Name: Default Oct 28 09:54:55.487985 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Project-Id: 500be47836b44a769f676e3e4bc00721 Oct 28 09:54:55.487985 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-146892991 Oct 28 09:54:55.487985 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Role: reader,member Oct 28 09:54:55.487985 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Roles: reader,member Oct 28 09:54:55.490391 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_500be47836b44a769f676e3e4bc00721"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/500be47836b44a769f676e3e4bc00721"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/500be47836b44a769f676e3e4bc00721"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/500be47836b44a769f676e3e4bc00721"}]}] Oct 28 09:54:55.490391 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Tenant: tempest-AttachVolumeShelveTestJSON-146892991 Oct 28 09:54:55.490391 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Tenant-Id: 500be47836b44a769f676e3e4bc00721 Oct 28 09:54:55.490391 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-146892991 Oct 28 09:54:55.490391 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User: tempest-AttachVolumeShelveTestJSON-146892991-project Oct 28 09:54:55.490391 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User-Domain-Id: default Oct 28 09:54:55.490391 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User-Domain-Name: Default Oct 28 09:54:55.490391 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User-Id: cdb5ce192c764fe4946542f5960ccd39 Oct 28 09:54:55.490391 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User-Name: tempest-AttachVolumeShelveTestJSON-146892991-project Oct 28 09:54:55.490391 dv-cinder-zed-3-smb devstack@n-api.service[127033]: method: > Oct 28 09:54:55.490391 dv-cinder-zed-3-smb devstack@n-api.service[127033]: exception: Instance 125194a5-e664-4ea8-ad7e-b0ae1b54e827 could not be found. Oct 28 09:54:55.490391 dv-cinder-zed-3-smb devstack@n-api.service[127033]: action_args: {'id': '125194a5-e664-4ea8-ad7e-b0ae1b54e827'} Oct 28 09:54:55.491217 dv-cinder-zed-3-smb devstack@n-api.service[127033]: {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:54:55.491217 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:54:55.491217 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 09:54:55.491217 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 09:54:55.491217 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 09:54:55.491217 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 09:54:55.491217 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 09:54:55.491217 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 09:54:55.491217 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 09:54:55.491217 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 09:54:55.491217 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 125194a5-e664-4ea8-ad7e-b0ae1b54e827 could not be found. Oct 28 09:54:55.491217 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:54:55.491217 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:54:55.491217 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:54:55.491217 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:54:55.491217 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:54:55.491217 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:54:55.491217 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:54:55.491217 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:54:55.491217 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:54:55.492577 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:54:55.492577 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 09:54:55.492577 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 09:54:55.492577 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 09:54:55.492577 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 09:54:55.492577 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 09:54:55.492577 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 09:54:55.492577 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 09:54:55.492577 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 09:54:55.492577 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 125194a5-e664-4ea8-ad7e-b0ae1b54e827 could not be found. Oct 28 09:54:55.492577 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:54:55.492577 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:54:55.492577 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:54:55.492577 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:54:55.492577 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:54:55.492577 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:54:55.492577 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:54:55.492577 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:54:55.492577 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 125194a5-e664-4ea8-ad7e-b0ae1b54e827 could not be found. Oct 28 09:54:55.492577 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:54:55.495599 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-aae889a0-d795-40a8-a394-c1ef7344be54 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Returning 404 to user: Instance 125194a5-e664-4ea8-ad7e-b0ae1b54e827 could not be found. {{(pid=127033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:54:55.495599 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-aae889a0-d795-40a8-a394-c1ef7344be54 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "DELETE /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827" status: 404 len: 111 microversion: 2.20 time: 0.031535 Oct 28 09:54:55.495599 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 401/817] 10.222.0.52 () {60 vars in 1280 bytes} [Fri Oct 28 09:54:55 2022] DELETE /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 09:54:55.498665 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-361a8d67-49f5-4b8c-8d92-b27405b03254 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:55.499272 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-361a8d67-49f5-4b8c-8d92-b27405b03254 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 125194a5-e664-4ea8-ad7e-b0ae1b54e827] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:55.505741 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-361a8d67-49f5-4b8c-8d92-b27405b03254 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:55.506229 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-361a8d67-49f5-4b8c-8d92-b27405b03254 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:55.506660 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-361a8d67-49f5-4b8c-8d92-b27405b03254 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:55.507341 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-361a8d67-49f5-4b8c-8d92-b27405b03254 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:55.507821 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-361a8d67-49f5-4b8c-8d92-b27405b03254 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:55.508244 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-361a8d67-49f5-4b8c-8d92-b27405b03254 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:55.521559 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.wsgi [None req-361a8d67-49f5-4b8c-8d92-b27405b03254 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] HTTP exception thrown: Instance 125194a5-e664-4ea8-ad7e-b0ae1b54e827 could not be found. Oct 28 09:54:55.523190 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-361a8d67-49f5-4b8c-8d92-b27405b03254 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Request method failure captured: Oct 28 09:54:55.523190 dv-cinder-zed-3-smb devstack@n-api.service[127032]: request: GET /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827 HTTP/1.1 Oct 28 09:54:55.523190 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Accept: application/json Oct 28 09:54:55.523190 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Accept-Encoding: identity Oct 28 09:54:55.523190 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Connection: close Oct 28 09:54:55.523190 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Content-Length: 0 Oct 28 09:54:55.523190 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Content-Type: application/json Oct 28 09:54:55.523190 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Host: 10.222.0.52 Oct 28 09:54:55.523190 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Openstack-System-Scope: None Oct 28 09:54:55.523190 dv-cinder-zed-3-smb devstack@n-api.service[127032]: User-Agent: python-urllib3/1.26.12 Oct 28 09:54:55.523190 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Auth-Token: gAAAAABjW6TL-nfZoagrIIL_YkE36KuSDhOXjvGtC86ZbtDlieloNediNRa004asnIbmA7I1lf0tqGniDyzY5Jn6NbXRpQF0NeqHU8m8plx6SCWuxsy2RWYlws615e7915D0F4ZQ8NM-WziiWXtDE7IRn9CZQrYKNwQBHwYHsx6or-8Vv8tPJcE Oct 28 09:54:55.523190 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Domain-Id: None Oct 28 09:54:55.523190 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Domain-Name: None Oct 28 09:54:55.523190 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Identity-Status: Confirmed Oct 28 09:54:55.523190 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Is-Admin-Project: True Oct 28 09:54:55.523190 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Openstack-Nova-Api-Version: 2.20 Oct 28 09:54:55.523190 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Project-Domain-Id: default Oct 28 09:54:55.523190 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Project-Domain-Name: Default Oct 28 09:54:55.523190 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Project-Id: 500be47836b44a769f676e3e4bc00721 Oct 28 09:54:55.523190 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-146892991 Oct 28 09:54:55.523190 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Role: reader,member Oct 28 09:54:55.523190 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Roles: reader,member Oct 28 09:54:55.524865 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_500be47836b44a769f676e3e4bc00721"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/500be47836b44a769f676e3e4bc00721"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/500be47836b44a769f676e3e4bc00721"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/500be47836b44a769f676e3e4bc00721"}]}] Oct 28 09:54:55.524865 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Tenant: tempest-AttachVolumeShelveTestJSON-146892991 Oct 28 09:54:55.524865 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Tenant-Id: 500be47836b44a769f676e3e4bc00721 Oct 28 09:54:55.524865 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-146892991 Oct 28 09:54:55.524865 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-User: tempest-AttachVolumeShelveTestJSON-146892991-project Oct 28 09:54:55.524865 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-User-Domain-Id: default Oct 28 09:54:55.524865 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-User-Domain-Name: Default Oct 28 09:54:55.524865 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-User-Id: cdb5ce192c764fe4946542f5960ccd39 Oct 28 09:54:55.524865 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-User-Name: tempest-AttachVolumeShelveTestJSON-146892991-project Oct 28 09:54:55.524865 dv-cinder-zed-3-smb devstack@n-api.service[127032]: method: > Oct 28 09:54:55.524865 dv-cinder-zed-3-smb devstack@n-api.service[127032]: exception: Instance 125194a5-e664-4ea8-ad7e-b0ae1b54e827 could not be found. Oct 28 09:54:55.524865 dv-cinder-zed-3-smb devstack@n-api.service[127032]: action_args: {'id': '125194a5-e664-4ea8-ad7e-b0ae1b54e827'} Oct 28 09:54:55.525748 dv-cinder-zed-3-smb devstack@n-api.service[127032]: {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:54:55.525748 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:54:55.525748 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 09:54:55.525748 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 09:54:55.525748 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 09:54:55.525748 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 09:54:55.525748 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 09:54:55.525748 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 09:54:55.525748 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 09:54:55.525748 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 09:54:55.525748 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 125194a5-e664-4ea8-ad7e-b0ae1b54e827 could not be found. Oct 28 09:54:55.525748 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Oct 28 09:54:55.525748 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:54:55.525748 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Oct 28 09:54:55.525748 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:54:55.525748 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:54:55.525748 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:54:55.525748 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:54:55.525748 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:54:55.525748 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:54:55.527264 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:54:55.527264 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 09:54:55.527264 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 09:54:55.527264 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 09:54:55.527264 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 09:54:55.527264 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 09:54:55.527264 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 09:54:55.527264 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 125194a5-e664-4ea8-ad7e-b0ae1b54e827 could not be found. Oct 28 09:54:55.527264 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Oct 28 09:54:55.527264 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:54:55.527264 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Oct 28 09:54:55.527264 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:54:55.527264 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:54:55.527264 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:54:55.527264 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:54:55.527264 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:54:55.527264 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 125194a5-e664-4ea8-ad7e-b0ae1b54e827 could not be found. Oct 28 09:54:55.527264 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Oct 28 09:54:55.528835 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-361a8d67-49f5-4b8c-8d92-b27405b03254 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Returning 404 to user: Instance 125194a5-e664-4ea8-ad7e-b0ae1b54e827 could not be found. {{(pid=127032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:54:55.528835 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-361a8d67-49f5-4b8c-8d92-b27405b03254 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827" status: 404 len: 111 microversion: 2.20 time: 0.030228 Oct 28 09:54:55.528835 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 417/818] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:54:55 2022] GET /compute/v2.1/servers/125194a5-e664-4ea8-ad7e-b0ae1b54e827 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 28 09:54:56.665493 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-9f6ebb3e-c61a-46c3-8ee2-46c86bce760e tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:56.665986 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-9f6ebb3e-c61a-46c3-8ee2-46c86bce760e tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 6869ffb6-ce4f-4a91-b8d9-7765ea56e95a] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:56.673086 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-9f6ebb3e-c61a-46c3-8ee2-46c86bce760e tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:56.673647 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-9f6ebb3e-c61a-46c3-8ee2-46c86bce760e tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:56.674009 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-9f6ebb3e-c61a-46c3-8ee2-46c86bce760e tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:56.674697 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-9f6ebb3e-c61a-46c3-8ee2-46c86bce760e tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:56.675160 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-9f6ebb3e-c61a-46c3-8ee2-46c86bce760e tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:56.675586 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-9f6ebb3e-c61a-46c3-8ee2-46c86bce760e tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:56.688830 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.wsgi [None req-9f6ebb3e-c61a-46c3-8ee2-46c86bce760e tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] HTTP exception thrown: Instance 6869ffb6-ce4f-4a91-b8d9-7765ea56e95a could not be found. Oct 28 09:54:56.690353 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-9f6ebb3e-c61a-46c3-8ee2-46c86bce760e tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Request method failure captured: Oct 28 09:54:56.690353 dv-cinder-zed-3-smb devstack@n-api.service[127033]: request: DELETE /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a HTTP/1.1 Oct 28 09:54:56.690353 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Accept: application/json Oct 28 09:54:56.690353 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Accept-Encoding: identity Oct 28 09:54:56.690353 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Connection: close Oct 28 09:54:56.690353 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Content-Length: 0 Oct 28 09:54:56.690353 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Content-Type: application/json Oct 28 09:54:56.690353 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Host: 10.222.0.52 Oct 28 09:54:56.690353 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Openstack-System-Scope: None Oct 28 09:54:56.690353 dv-cinder-zed-3-smb devstack@n-api.service[127033]: User-Agent: python-urllib3/1.26.12 Oct 28 09:54:56.690353 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Auth-Token: gAAAAABjW6TL-nfZoagrIIL_YkE36KuSDhOXjvGtC86ZbtDlieloNediNRa004asnIbmA7I1lf0tqGniDyzY5Jn6NbXRpQF0NeqHU8m8plx6SCWuxsy2RWYlws615e7915D0F4ZQ8NM-WziiWXtDE7IRn9CZQrYKNwQBHwYHsx6or-8Vv8tPJcE Oct 28 09:54:56.690353 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Domain-Id: None Oct 28 09:54:56.690353 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Domain-Name: None Oct 28 09:54:56.690353 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Identity-Status: Confirmed Oct 28 09:54:56.690353 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Is-Admin-Project: True Oct 28 09:54:56.690353 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Openstack-Nova-Api-Version: 2.20 Oct 28 09:54:56.690353 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Project-Domain-Id: default Oct 28 09:54:56.690353 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Project-Domain-Name: Default Oct 28 09:54:56.690353 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Project-Id: 500be47836b44a769f676e3e4bc00721 Oct 28 09:54:56.690353 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-146892991 Oct 28 09:54:56.690353 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Role: reader,member Oct 28 09:54:56.690353 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Roles: reader,member Oct 28 09:54:56.692036 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_500be47836b44a769f676e3e4bc00721"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/500be47836b44a769f676e3e4bc00721"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/500be47836b44a769f676e3e4bc00721"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/500be47836b44a769f676e3e4bc00721"}]}] Oct 28 09:54:56.692036 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Tenant: tempest-AttachVolumeShelveTestJSON-146892991 Oct 28 09:54:56.692036 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Tenant-Id: 500be47836b44a769f676e3e4bc00721 Oct 28 09:54:56.692036 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-146892991 Oct 28 09:54:56.692036 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User: tempest-AttachVolumeShelveTestJSON-146892991-project Oct 28 09:54:56.692036 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User-Domain-Id: default Oct 28 09:54:56.692036 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User-Domain-Name: Default Oct 28 09:54:56.692036 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User-Id: cdb5ce192c764fe4946542f5960ccd39 Oct 28 09:54:56.692036 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User-Name: tempest-AttachVolumeShelveTestJSON-146892991-project Oct 28 09:54:56.692036 dv-cinder-zed-3-smb devstack@n-api.service[127033]: method: > Oct 28 09:54:56.692036 dv-cinder-zed-3-smb devstack@n-api.service[127033]: exception: Instance 6869ffb6-ce4f-4a91-b8d9-7765ea56e95a could not be found. Oct 28 09:54:56.692036 dv-cinder-zed-3-smb devstack@n-api.service[127033]: action_args: {'id': '6869ffb6-ce4f-4a91-b8d9-7765ea56e95a'} Oct 28 09:54:56.692923 dv-cinder-zed-3-smb devstack@n-api.service[127033]: {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:54:56.692923 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:54:56.692923 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 09:54:56.692923 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 09:54:56.692923 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 09:54:56.692923 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 09:54:56.692923 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 09:54:56.692923 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 09:54:56.692923 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 09:54:56.692923 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 09:54:56.692923 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6869ffb6-ce4f-4a91-b8d9-7765ea56e95a could not be found. Oct 28 09:54:56.692923 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:54:56.692923 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:54:56.692923 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:54:56.692923 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:54:56.692923 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:54:56.692923 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:54:56.692923 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:54:56.692923 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:54:56.692923 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:54:56.694357 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:54:56.694357 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 09:54:56.694357 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 09:54:56.694357 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 09:54:56.694357 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 09:54:56.694357 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 09:54:56.694357 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 09:54:56.694357 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 09:54:56.694357 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 09:54:56.694357 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6869ffb6-ce4f-4a91-b8d9-7765ea56e95a could not be found. Oct 28 09:54:56.694357 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:54:56.694357 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:54:56.694357 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:54:56.694357 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:54:56.694357 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:54:56.694357 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:54:56.694357 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:54:56.694357 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:54:56.694357 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6869ffb6-ce4f-4a91-b8d9-7765ea56e95a could not be found. Oct 28 09:54:56.694357 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:54:56.695855 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-9f6ebb3e-c61a-46c3-8ee2-46c86bce760e tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Returning 404 to user: Instance 6869ffb6-ce4f-4a91-b8d9-7765ea56e95a could not be found. {{(pid=127033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:54:56.695855 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-9f6ebb3e-c61a-46c3-8ee2-46c86bce760e tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "DELETE /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a" status: 404 len: 111 microversion: 2.20 time: 0.030171 Oct 28 09:54:56.695855 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 402/819] 10.222.0.52 () {60 vars in 1280 bytes} [Fri Oct 28 09:54:56 2022] DELETE /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 09:54:56.700434 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-7fbb12d7-c748-4eb9-a115-7ea53eb56394 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:56.701037 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-7fbb12d7-c748-4eb9-a115-7ea53eb56394 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] [instance: 6869ffb6-ce4f-4a91-b8d9-7765ea56e95a] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:56.707319 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-7fbb12d7-c748-4eb9-a115-7ea53eb56394 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:56.707818 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-7fbb12d7-c748-4eb9-a115-7ea53eb56394 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:56.708248 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-7fbb12d7-c748-4eb9-a115-7ea53eb56394 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:56.708925 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-7fbb12d7-c748-4eb9-a115-7ea53eb56394 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:56.709373 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-7fbb12d7-c748-4eb9-a115-7ea53eb56394 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:56.709790 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-7fbb12d7-c748-4eb9-a115-7ea53eb56394 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:56.723139 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.wsgi [None req-7fbb12d7-c748-4eb9-a115-7ea53eb56394 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] HTTP exception thrown: Instance 6869ffb6-ce4f-4a91-b8d9-7765ea56e95a could not be found. Oct 28 09:54:56.724673 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-7fbb12d7-c748-4eb9-a115-7ea53eb56394 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Request method failure captured: Oct 28 09:54:56.724673 dv-cinder-zed-3-smb devstack@n-api.service[127032]: request: GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a HTTP/1.1 Oct 28 09:54:56.724673 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Accept: application/json Oct 28 09:54:56.724673 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Accept-Encoding: identity Oct 28 09:54:56.724673 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Connection: close Oct 28 09:54:56.724673 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Content-Length: 0 Oct 28 09:54:56.724673 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Content-Type: application/json Oct 28 09:54:56.724673 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Host: 10.222.0.52 Oct 28 09:54:56.724673 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Openstack-System-Scope: None Oct 28 09:54:56.724673 dv-cinder-zed-3-smb devstack@n-api.service[127032]: User-Agent: python-urllib3/1.26.12 Oct 28 09:54:56.724673 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Auth-Token: gAAAAABjW6TL-nfZoagrIIL_YkE36KuSDhOXjvGtC86ZbtDlieloNediNRa004asnIbmA7I1lf0tqGniDyzY5Jn6NbXRpQF0NeqHU8m8plx6SCWuxsy2RWYlws615e7915D0F4ZQ8NM-WziiWXtDE7IRn9CZQrYKNwQBHwYHsx6or-8Vv8tPJcE Oct 28 09:54:56.724673 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Domain-Id: None Oct 28 09:54:56.724673 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Domain-Name: None Oct 28 09:54:56.724673 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Identity-Status: Confirmed Oct 28 09:54:56.724673 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Is-Admin-Project: True Oct 28 09:54:56.724673 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Openstack-Nova-Api-Version: 2.20 Oct 28 09:54:56.724673 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Project-Domain-Id: default Oct 28 09:54:56.724673 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Project-Domain-Name: Default Oct 28 09:54:56.724673 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Project-Id: 500be47836b44a769f676e3e4bc00721 Oct 28 09:54:56.724673 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-146892991 Oct 28 09:54:56.724673 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Role: reader,member Oct 28 09:54:56.724673 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Roles: reader,member Oct 28 09:54:56.726378 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_500be47836b44a769f676e3e4bc00721"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/500be47836b44a769f676e3e4bc00721"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/500be47836b44a769f676e3e4bc00721"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/500be47836b44a769f676e3e4bc00721"}]}] Oct 28 09:54:56.726378 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Tenant: tempest-AttachVolumeShelveTestJSON-146892991 Oct 28 09:54:56.726378 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Tenant-Id: 500be47836b44a769f676e3e4bc00721 Oct 28 09:54:56.726378 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-146892991 Oct 28 09:54:56.726378 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-User: tempest-AttachVolumeShelveTestJSON-146892991-project Oct 28 09:54:56.726378 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-User-Domain-Id: default Oct 28 09:54:56.726378 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-User-Domain-Name: Default Oct 28 09:54:56.726378 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-User-Id: cdb5ce192c764fe4946542f5960ccd39 Oct 28 09:54:56.726378 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-User-Name: tempest-AttachVolumeShelveTestJSON-146892991-project Oct 28 09:54:56.726378 dv-cinder-zed-3-smb devstack@n-api.service[127032]: method: > Oct 28 09:54:56.726378 dv-cinder-zed-3-smb devstack@n-api.service[127032]: exception: Instance 6869ffb6-ce4f-4a91-b8d9-7765ea56e95a could not be found. Oct 28 09:54:56.726378 dv-cinder-zed-3-smb devstack@n-api.service[127032]: action_args: {'id': '6869ffb6-ce4f-4a91-b8d9-7765ea56e95a'} Oct 28 09:54:56.727178 dv-cinder-zed-3-smb devstack@n-api.service[127032]: {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:54:56.727178 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:54:56.727178 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 09:54:56.727178 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 09:54:56.727178 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 09:54:56.727178 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 09:54:56.727178 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 09:54:56.727178 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 09:54:56.727178 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 09:54:56.727178 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 09:54:56.727178 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6869ffb6-ce4f-4a91-b8d9-7765ea56e95a could not be found. Oct 28 09:54:56.727178 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Oct 28 09:54:56.727178 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:54:56.727178 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Oct 28 09:54:56.727178 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:54:56.727178 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:54:56.727178 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:54:56.727178 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:54:56.727178 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:54:56.727178 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:54:56.729077 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:54:56.729077 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 09:54:56.729077 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 09:54:56.729077 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 09:54:56.729077 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 09:54:56.729077 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 09:54:56.729077 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 09:54:56.729077 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6869ffb6-ce4f-4a91-b8d9-7765ea56e95a could not be found. Oct 28 09:54:56.729077 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Oct 28 09:54:56.729077 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:54:56.729077 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Oct 28 09:54:56.729077 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:54:56.729077 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:54:56.729077 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:54:56.729077 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:54:56.729077 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:54:56.729077 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6869ffb6-ce4f-4a91-b8d9-7765ea56e95a could not be found. Oct 28 09:54:56.729077 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Oct 28 09:54:56.730197 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-7fbb12d7-c748-4eb9-a115-7ea53eb56394 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] Returning 404 to user: Instance 6869ffb6-ce4f-4a91-b8d9-7765ea56e95a could not be found. {{(pid=127032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:54:56.730197 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-7fbb12d7-c748-4eb9-a115-7ea53eb56394 tempest-AttachVolumeShelveTestJSON-146892991 tempest-AttachVolumeShelveTestJSON-146892991-project] 10.222.0.52 "GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a" status: 404 len: 111 microversion: 2.20 time: 0.029534 Oct 28 09:54:56.730197 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 418/820] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Oct 28 09:54:56 2022] GET /compute/v2.1/servers/6869ffb6-ce4f-4a91-b8d9-7765ea56e95a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 09:55:44.326168 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-7f75a2a6-52ab-4ade-adcd-66336804b418 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Action: 'create', calling method: .version_select at 0x7ff0103e98b0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1587584653", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP084VL40qyNseE7USddesDJQpFQOYRnE53woJ2m0Ek0uD/w8anyq8oTKTLkbj1EoFUxSWliiIPSEXN8ZX84vY2opg71/z5C99XWZ8udDR3BmQ6GL5H9YpcCInFohOCIPw=="}} {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:55:44.331579 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG dbcounter [-] [127033] Writing DB stats nova_api:SELECT=12 {{(pid=127033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:55:44.332267 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG dbcounter [-] [127033] Writing DB stats nova_cell1:SELECT=20 {{(pid=127033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:55:44.333080 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 09:55:44.333221 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Fri Oct 28 09:55:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.52) !!! Oct 28 09:55:44.349006 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.quota [None req-7f75a2a6-52ab-4ade-adcd-66336804b418 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Getting quotas for project 1659fef961ae4ccda1adf6b62c018c9e. Resources: {'key_pairs'} {{(pid=127033) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 09:55:44.353156 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.quota [None req-7f75a2a6-52ab-4ade-adcd-66336804b418 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Getting quotas for user c2771d02bec4465d94e98134015b9705 and project 1659fef961ae4ccda1adf6b62c018c9e. Resources: {'key_pairs'} {{(pid=127033) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 09:55:44.375684 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-7f75a2a6-52ab-4ade-adcd-66336804b418 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.053579 Oct 28 09:55:44.376326 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 403/821] 10.222.0.52 () {60 vars in 1159 bytes} [Fri Oct 28 09:55:44 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:55:44.430100 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-440cfecd-0ebd-4ddf-8545-3ad6cc4ff40e tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1189518614", "imageRef": "2344cdc5-cdb7-40fa-8d44-27d7de6698d5", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1587584653", "networks": [{"uuid": "bfa99a40-57ed-4139-a871-869fcbe772dd"}]}} {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:55:44.438722 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG dbcounter [-] [127032] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:55:44.439402 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG dbcounter [-] [127032] Writing DB stats nova_cell1:SELECT=30,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:55:44.592299 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.network.neutron [None req-440cfecd-0ebd-4ddf-8545-3ad6cc4ff40e tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] validate_networks() for [('bfa99a40-57ed-4139-a871-869fcbe772dd', None, None, None, None, None)] {{(pid=127032) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 09:55:44.966382 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.virt.hardware [None req-440cfecd-0ebd-4ddf-8545-3ad6cc4ff40e tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Flavor limits 0:0:0 {{(pid=127032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 09:55:44.966802 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.virt.hardware [None req-440cfecd-0ebd-4ddf-8545-3ad6cc4ff40e tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Image limits 0:0:0 {{(pid=127032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 09:55:44.967291 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.virt.hardware [None req-440cfecd-0ebd-4ddf-8545-3ad6cc4ff40e tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Flavor pref 0:0:0 {{(pid=127032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 09:55:44.967691 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.virt.hardware [None req-440cfecd-0ebd-4ddf-8545-3ad6cc4ff40e tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Image pref 0:0:0 {{(pid=127032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 09:55:44.968124 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.virt.hardware [None req-440cfecd-0ebd-4ddf-8545-3ad6cc4ff40e tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 09:55:44.977438 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-440cfecd-0ebd-4ddf-8545-3ad6cc4ff40e tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:44.977918 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-440cfecd-0ebd-4ddf-8545-3ad6cc4ff40e tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:44.978343 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-440cfecd-0ebd-4ddf-8545-3ad6cc4ff40e tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:44.979058 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-440cfecd-0ebd-4ddf-8545-3ad6cc4ff40e tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:44.979506 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-440cfecd-0ebd-4ddf-8545-3ad6cc4ff40e tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:44.979957 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-440cfecd-0ebd-4ddf-8545-3ad6cc4ff40e tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:44.996294 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.quota [None req-440cfecd-0ebd-4ddf-8545-3ad6cc4ff40e tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Getting quotas for project 1659fef961ae4ccda1adf6b62c018c9e. Resources: {'cores', 'ram', 'instances'} {{(pid=127032) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 09:55:45.000178 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.quota [None req-440cfecd-0ebd-4ddf-8545-3ad6cc4ff40e tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Getting quotas for user c2771d02bec4465d94e98134015b9705 and project 1659fef961ae4ccda1adf6b62c018c9e. Resources: {'cores', 'ram', 'instances'} {{(pid=127032) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 09:55:45.011347 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-440cfecd-0ebd-4ddf-8545-3ad6cc4ff40e tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Going to run 1 instances... {{(pid=127032) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 09:55:45.013574 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-440cfecd-0ebd-4ddf-8545-3ad6cc4ff40e tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] [instance: ad989c34-1973-42cb-82ea-637973bf8d4f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2344cdc5-cdb7-40fa-8d44-27d7de6698d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127032) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 09:55:45.060793 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-440cfecd-0ebd-4ddf-8545-3ad6cc4ff40e tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.635860 Oct 28 09:55:45.061431 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 419/822] 10.222.0.52 () {60 vars in 1147 bytes} [Fri Oct 28 09:55:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 638 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 09:55:45.073352 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-40e6162c-c35c-4f51-a5ab-cdcb9c68756f tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:45.073968 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-40e6162c-c35c-4f51-a5ab-cdcb9c68756f tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] [instance: ad989c34-1973-42cb-82ea-637973bf8d4f] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:45.236275 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-40e6162c-c35c-4f51-a5ab-cdcb9c68756f tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2771d02bec4465d94e98134015b9705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1659fef961ae4ccda1adf6b62c018c9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:45.243192 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-40e6162c-c35c-4f51-a5ab-cdcb9c68756f tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] 10.222.0.52 "GET /compute/v2.1/servers/ad989c34-1973-42cb-82ea-637973bf8d4f" status: 200 len: 1259 microversion: 2.1 time: 0.173882 Oct 28 09:55:45.243847 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 404/823] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:45 2022] GET /compute/v2.1/servers/ad989c34-1973-42cb-82ea-637973bf8d4f => generated 1259 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:46.266789 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-477b2188-071c-47d2-8c44-28d73daab35a tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:46.268592 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-477b2188-071c-47d2-8c44-28d73daab35a tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] [instance: ad989c34-1973-42cb-82ea-637973bf8d4f] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:46.275906 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-477b2188-071c-47d2-8c44-28d73daab35a tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:46.276742 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-477b2188-071c-47d2-8c44-28d73daab35a tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:46.277242 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-477b2188-071c-47d2-8c44-28d73daab35a tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:46.278012 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-477b2188-071c-47d2-8c44-28d73daab35a tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:46.278537 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-477b2188-071c-47d2-8c44-28d73daab35a tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:46.279172 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-477b2188-071c-47d2-8c44-28d73daab35a tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:46.346055 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-477b2188-071c-47d2-8c44-28d73daab35a tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2771d02bec4465d94e98134015b9705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1659fef961ae4ccda1adf6b62c018c9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:46.356865 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-477b2188-071c-47d2-8c44-28d73daab35a tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] 10.222.0.52 "GET /compute/v2.1/servers/ad989c34-1973-42cb-82ea-637973bf8d4f" status: 200 len: 1329 microversion: 2.1 time: 0.093836 Oct 28 09:55:46.357962 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 420/824] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:46 2022] GET /compute/v2.1/servers/ad989c34-1973-42cb-82ea-637973bf8d4f => generated 1329 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:46.423895 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-fef4a16a-2609-41d4-bfe8-8212d14b6fcd tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:46.424465 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-fef4a16a-2609-41d4-bfe8-8212d14b6fcd tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] [instance: 91ca6322-9cdc-4106-8021-811be2c4af7f] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:46.431124 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-fef4a16a-2609-41d4-bfe8-8212d14b6fcd tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:46.431603 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-fef4a16a-2609-41d4-bfe8-8212d14b6fcd tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:46.432050 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-fef4a16a-2609-41d4-bfe8-8212d14b6fcd tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:46.432734 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-fef4a16a-2609-41d4-bfe8-8212d14b6fcd tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:46.433183 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-fef4a16a-2609-41d4-bfe8-8212d14b6fcd tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:46.433598 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-fef4a16a-2609-41d4-bfe8-8212d14b6fcd tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:46.461208 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-fef4a16a-2609-41d4-bfe8-8212d14b6fcd tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] 10.222.0.52 "GET /compute/v2.1/servers/91ca6322-9cdc-4106-8021-811be2c4af7f/ips" status: 200 len: 150 microversion: 2.1 time: 0.041418 Oct 28 09:55:46.461813 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 405/825] 10.222.0.52 () {58 vars in 1248 bytes} [Fri Oct 28 09:55:46 2022] GET /compute/v2.1/servers/91ca6322-9cdc-4106-8021-811be2c4af7f/ips => generated 150 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:55:46.474723 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-181a09a9-61ff-4dc6-9524-84cfdb506f51 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "95ee2c9f-876a-4f48-a969-8347aaa671bb"}} {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:55:46.477329 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-181a09a9-61ff-4dc6-9524-84cfdb506f51 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] [instance: 91ca6322-9cdc-4106-8021-811be2c4af7f] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:46.485486 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-181a09a9-61ff-4dc6-9524-84cfdb506f51 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:46.485986 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-181a09a9-61ff-4dc6-9524-84cfdb506f51 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:46.486422 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-181a09a9-61ff-4dc6-9524-84cfdb506f51 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:46.487306 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-181a09a9-61ff-4dc6-9524-84cfdb506f51 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:46.487783 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-181a09a9-61ff-4dc6-9524-84cfdb506f51 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:46.488212 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-181a09a9-61ff-4dc6-9524-84cfdb506f51 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:46.587414 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.wsgi [None req-181a09a9-61ff-4dc6-9524-84cfdb506f51 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] HTTP exception thrown: Invalid volume: volume 95ee2c9f-876a-4f48-a969-8347aaa671bb is already attached to instances: 239cbe4b-b0d1-4361-80af-f3015cb39176 Oct 28 09:55:46.589270 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-181a09a9-61ff-4dc6-9524-84cfdb506f51 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Request method failure captured: Oct 28 09:55:46.589270 dv-cinder-zed-3-smb devstack@n-api.service[127032]: request: POST /compute/v2.1/servers/91ca6322-9cdc-4106-8021-811be2c4af7f/os-volume_attachments HTTP/1.1 Oct 28 09:55:46.589270 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Accept: application/json Oct 28 09:55:46.589270 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Accept-Encoding: identity Oct 28 09:55:46.589270 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Connection: close Oct 28 09:55:46.589270 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Content-Length: 74 Oct 28 09:55:46.589270 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Content-Type: application/json Oct 28 09:55:46.589270 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Host: 10.222.0.52 Oct 28 09:55:46.589270 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Openstack-System-Scope: None Oct 28 09:55:46.589270 dv-cinder-zed-3-smb devstack@n-api.service[127032]: User-Agent: python-urllib3/1.26.12 Oct 28 09:55:46.589270 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Auth-Token: gAAAAABjW6ZlB_y8UlHttqFpTZf-FQqNFL8UpqBADpRqoMnMvW_jAoL6f5CF8d3TJuqshSrx4zOxOgPBQaaPIBzA2l5d4VliO6WO9dxAWAz2QeafoRTcYtg1CKFv-cJOUbVbMelTlyaihpwFtFOGoW8EkNwvlaaR3DGtxA3ButWLQbGRra0UmvI Oct 28 09:55:46.589270 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Domain-Id: None Oct 28 09:55:46.589270 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Domain-Name: None Oct 28 09:55:46.589270 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Identity-Status: Confirmed Oct 28 09:55:46.589270 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Is-Admin-Project: True Oct 28 09:55:46.589270 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Project-Domain-Id: default Oct 28 09:55:46.589270 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Project-Domain-Name: Default Oct 28 09:55:46.589270 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Project-Id: 68e60d7c624e49e1bb43188ae9d7dd2b Oct 28 09:55:46.589270 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Project-Name: tempest-AttachVolumeNegativeTest-21111899 Oct 28 09:55:46.589270 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Role: reader,member Oct 28 09:55:46.589270 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Roles: reader,member Oct 28 09:55:46.590961 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_68e60d7c624e49e1bb43188ae9d7dd2b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/68e60d7c624e49e1bb43188ae9d7dd2b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/68e60d7c624e49e1bb43188ae9d7dd2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/68e60d7c624e49e1bb43188ae9d7dd2b"}]}] Oct 28 09:55:46.590961 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Tenant: tempest-AttachVolumeNegativeTest-21111899 Oct 28 09:55:46.590961 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Tenant-Id: 68e60d7c624e49e1bb43188ae9d7dd2b Oct 28 09:55:46.590961 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-21111899 Oct 28 09:55:46.590961 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-User: tempest-AttachVolumeNegativeTest-21111899-project Oct 28 09:55:46.590961 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-User-Domain-Id: default Oct 28 09:55:46.590961 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-User-Domain-Name: Default Oct 28 09:55:46.590961 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-User-Id: d38ce75423b5412d90c1158396978b97 Oct 28 09:55:46.590961 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-User-Name: tempest-AttachVolumeNegativeTest-21111899-project Oct 28 09:55:46.590961 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Oct 28 09:55:46.590961 dv-cinder-zed-3-smb devstack@n-api.service[127032]: {"volumeAttachment": {"volumeId": "95ee2c9f-876a-4f48-a969-8347aaa671bb"}} Oct 28 09:55:46.590961 dv-cinder-zed-3-smb devstack@n-api.service[127032]: method: > Oct 28 09:55:46.591926 dv-cinder-zed-3-smb devstack@n-api.service[127032]: exception: Invalid volume: volume 95ee2c9f-876a-4f48-a969-8347aaa671bb is already attached to instances: 239cbe4b-b0d1-4361-80af-f3015cb39176 Oct 28 09:55:46.591926 dv-cinder-zed-3-smb devstack@n-api.service[127032]: action_args: {'server_id': '91ca6322-9cdc-4106-8021-811be2c4af7f', 'body': {'volumeAttachment': {'volumeId': '95ee2c9f-876a-4f48-a969-8347aaa671bb'}}} Oct 28 09:55:46.591926 dv-cinder-zed-3-smb devstack@n-api.service[127032]: {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:55:46.591926 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:55:46.591926 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 28 09:55:46.591926 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 28 09:55:46.591926 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 28 09:55:46.591926 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 09:55:46.591926 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 28 09:55:46.591926 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 28 09:55:46.591926 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 28 09:55:46.591926 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 28 09:55:46.591926 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 28 09:55:46.591926 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 28 09:55:46.591926 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 95ee2c9f-876a-4f48-a969-8347aaa671bb is already attached to instances: 239cbe4b-b0d1-4361-80af-f3015cb39176 Oct 28 09:55:46.591926 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Oct 28 09:55:46.591926 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:55:46.591926 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Oct 28 09:55:46.591926 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:55:46.593974 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:55:46.593974 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:55:46.593974 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:55:46.593974 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:55:46.593974 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:55:46.593974 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:55:46.593974 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 09:55:46.593974 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 09:55:46.593974 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 09:55:46.593974 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 09:55:46.593974 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 09:55:46.593974 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 09:55:46.593974 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 28 09:55:46.593974 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 28 09:55:46.593974 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 95ee2c9f-876a-4f48-a969-8347aaa671bb is already attached to instances: 239cbe4b-b0d1-4361-80af-f3015cb39176 Oct 28 09:55:46.593974 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Oct 28 09:55:46.593974 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:55:46.593974 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Oct 28 09:55:46.593974 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:55:46.593974 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:55:46.595487 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:55:46.595487 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:55:46.595487 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:55:46.595487 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 95ee2c9f-876a-4f48-a969-8347aaa671bb is already attached to instances: 239cbe4b-b0d1-4361-80af-f3015cb39176 Oct 28 09:55:46.595487 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Oct 28 09:55:46.596859 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-181a09a9-61ff-4dc6-9524-84cfdb506f51 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Returning 400 to user: Invalid volume: volume 95ee2c9f-876a-4f48-a969-8347aaa671bb is already attached to instances: 239cbe4b-b0d1-4361-80af-f3015cb39176 {{(pid=127032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:55:46.598194 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-181a09a9-61ff-4dc6-9524-84cfdb506f51 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] 10.222.0.52 "POST /compute/v2.1/servers/91ca6322-9cdc-4106-8021-811be2c4af7f/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.128528 Oct 28 09:55:46.599844 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 421/826] 10.222.0.52 () {60 vars in 1323 bytes} [Fri Oct 28 09:55:46 2022] POST /compute/v2.1/servers/91ca6322-9cdc-4106-8021-811be2c4af7f/os-volume_attachments => generated 174 bytes in 131 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 28 09:55:46.608031 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-55fa40c5-5782-45f0-9df2-a381d669cc1c tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:46.608536 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-55fa40c5-5782-45f0-9df2-a381d669cc1c tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] [instance: 91ca6322-9cdc-4106-8021-811be2c4af7f] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:46.614598 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-55fa40c5-5782-45f0-9df2-a381d669cc1c tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:46.615159 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-55fa40c5-5782-45f0-9df2-a381d669cc1c tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:46.615520 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-55fa40c5-5782-45f0-9df2-a381d669cc1c tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:46.616370 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-55fa40c5-5782-45f0-9df2-a381d669cc1c tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:46.616842 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-55fa40c5-5782-45f0-9df2-a381d669cc1c tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:46.617197 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-55fa40c5-5782-45f0-9df2-a381d669cc1c tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:46.649523 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-55fa40c5-5782-45f0-9df2-a381d669cc1c tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] [instance: 91ca6322-9cdc-4106-8021-811be2c4af7f] Going to try to terminate instance {{(pid=127033) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 09:55:46.781988 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-55fa40c5-5782-45f0-9df2-a381d669cc1c tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] 10.222.0.52 "DELETE /compute/v2.1/servers/91ca6322-9cdc-4106-8021-811be2c4af7f" status: 204 len: 0 microversion: 2.1 time: 0.177514 Oct 28 09:55:46.782619 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 406/827] 10.222.0.52 () {58 vars in 1239 bytes} [Fri Oct 28 09:55:46 2022] DELETE /compute/v2.1/servers/91ca6322-9cdc-4106-8021-811be2c4af7f => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 09:55:46.790757 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-ea7d5389-31cd-4dd2-9e60-e6f6d82b0e36 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:46.791681 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-ea7d5389-31cd-4dd2-9e60-e6f6d82b0e36 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] [instance: 91ca6322-9cdc-4106-8021-811be2c4af7f] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:46.801438 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ea7d5389-31cd-4dd2-9e60-e6f6d82b0e36 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:46.803250 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ea7d5389-31cd-4dd2-9e60-e6f6d82b0e36 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:46.803942 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ea7d5389-31cd-4dd2-9e60-e6f6d82b0e36 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:46.804965 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ea7d5389-31cd-4dd2-9e60-e6f6d82b0e36 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:46.805573 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ea7d5389-31cd-4dd2-9e60-e6f6d82b0e36 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:46.806364 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ea7d5389-31cd-4dd2-9e60-e6f6d82b0e36 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:47.230654 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-ea7d5389-31cd-4dd2-9e60-e6f6d82b0e36 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38ce75423b5412d90c1158396978b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e60d7c624e49e1bb43188ae9d7dd2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:47.239059 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-ea7d5389-31cd-4dd2-9e60-e6f6d82b0e36 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] 10.222.0.52 "GET /compute/v2.1/servers/91ca6322-9cdc-4106-8021-811be2c4af7f" status: 200 len: 1682 microversion: 2.1 time: 0.452043 Oct 28 09:55:47.239627 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 422/828] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:46 2022] GET /compute/v2.1/servers/91ca6322-9cdc-4106-8021-811be2c4af7f => generated 1682 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:47.383546 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-90ae084d-5871-4e24-8853-3081aef795bd tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:47.384274 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-90ae084d-5871-4e24-8853-3081aef795bd tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] [instance: ad989c34-1973-42cb-82ea-637973bf8d4f] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:47.390159 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-90ae084d-5871-4e24-8853-3081aef795bd tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:47.390641 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-90ae084d-5871-4e24-8853-3081aef795bd tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:47.391077 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-90ae084d-5871-4e24-8853-3081aef795bd tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:47.391781 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-90ae084d-5871-4e24-8853-3081aef795bd tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:47.392817 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-90ae084d-5871-4e24-8853-3081aef795bd tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:47.393245 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-90ae084d-5871-4e24-8853-3081aef795bd tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:47.522546 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-90ae084d-5871-4e24-8853-3081aef795bd tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2771d02bec4465d94e98134015b9705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1659fef961ae4ccda1adf6b62c018c9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:47.530294 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-90ae084d-5871-4e24-8853-3081aef795bd tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] 10.222.0.52 "GET /compute/v2.1/servers/ad989c34-1973-42cb-82ea-637973bf8d4f" status: 200 len: 1359 microversion: 2.1 time: 0.151040 Oct 28 09:55:47.530894 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 407/829] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:47 2022] GET /compute/v2.1/servers/ad989c34-1973-42cb-82ea-637973bf8d4f => generated 1359 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:48.264435 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-fb6c6903-ec55-4b76-94ad-37a1dad4acb8 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:48.265027 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-fb6c6903-ec55-4b76-94ad-37a1dad4acb8 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] [instance: 91ca6322-9cdc-4106-8021-811be2c4af7f] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:48.272367 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-fb6c6903-ec55-4b76-94ad-37a1dad4acb8 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:48.272854 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-fb6c6903-ec55-4b76-94ad-37a1dad4acb8 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:48.273288 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-fb6c6903-ec55-4b76-94ad-37a1dad4acb8 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:48.273987 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-fb6c6903-ec55-4b76-94ad-37a1dad4acb8 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:48.274437 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-fb6c6903-ec55-4b76-94ad-37a1dad4acb8 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:48.274861 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-fb6c6903-ec55-4b76-94ad-37a1dad4acb8 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:48.414161 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-fb6c6903-ec55-4b76-94ad-37a1dad4acb8 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38ce75423b5412d90c1158396978b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e60d7c624e49e1bb43188ae9d7dd2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:48.422238 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-fb6c6903-ec55-4b76-94ad-37a1dad4acb8 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] 10.222.0.52 "GET /compute/v2.1/servers/91ca6322-9cdc-4106-8021-811be2c4af7f" status: 200 len: 1682 microversion: 2.1 time: 0.161561 Oct 28 09:55:48.422810 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 423/830] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:48 2022] GET /compute/v2.1/servers/91ca6322-9cdc-4106-8021-811be2c4af7f => generated 1682 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:48.554236 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-15e907b1-8ea1-45d7-8692-a05a589702d5 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:48.554942 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-15e907b1-8ea1-45d7-8692-a05a589702d5 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] [instance: ad989c34-1973-42cb-82ea-637973bf8d4f] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:48.561393 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-15e907b1-8ea1-45d7-8692-a05a589702d5 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:48.561884 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-15e907b1-8ea1-45d7-8692-a05a589702d5 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:48.562316 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-15e907b1-8ea1-45d7-8692-a05a589702d5 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:48.563017 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-15e907b1-8ea1-45d7-8692-a05a589702d5 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:48.563463 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-15e907b1-8ea1-45d7-8692-a05a589702d5 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:48.564101 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-15e907b1-8ea1-45d7-8692-a05a589702d5 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:48.703554 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-15e907b1-8ea1-45d7-8692-a05a589702d5 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2771d02bec4465d94e98134015b9705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1659fef961ae4ccda1adf6b62c018c9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:48.713135 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-15e907b1-8ea1-45d7-8692-a05a589702d5 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] 10.222.0.52 "GET /compute/v2.1/servers/ad989c34-1973-42cb-82ea-637973bf8d4f" status: 200 len: 1359 microversion: 2.1 time: 0.162715 Oct 28 09:55:48.715340 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 408/831] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:48 2022] GET /compute/v2.1/servers/ad989c34-1973-42cb-82ea-637973bf8d4f => generated 1359 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:49.445517 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-9b7db14a-8c9d-489c-85f3-001e52c2e337 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:49.446202 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-9b7db14a-8c9d-489c-85f3-001e52c2e337 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] [instance: 91ca6322-9cdc-4106-8021-811be2c4af7f] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:49.452768 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-9b7db14a-8c9d-489c-85f3-001e52c2e337 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:49.453252 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-9b7db14a-8c9d-489c-85f3-001e52c2e337 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:49.453683 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-9b7db14a-8c9d-489c-85f3-001e52c2e337 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:49.454380 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-9b7db14a-8c9d-489c-85f3-001e52c2e337 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:49.455379 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-9b7db14a-8c9d-489c-85f3-001e52c2e337 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:49.455815 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-9b7db14a-8c9d-489c-85f3-001e52c2e337 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:49.623411 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-9b7db14a-8c9d-489c-85f3-001e52c2e337 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38ce75423b5412d90c1158396978b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e60d7c624e49e1bb43188ae9d7dd2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:49.634085 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-9b7db14a-8c9d-489c-85f3-001e52c2e337 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] 10.222.0.52 "GET /compute/v2.1/servers/91ca6322-9cdc-4106-8021-811be2c4af7f" status: 200 len: 1682 microversion: 2.1 time: 0.192321 Oct 28 09:55:49.634930 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 424/832] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:49 2022] GET /compute/v2.1/servers/91ca6322-9cdc-4106-8021-811be2c4af7f => generated 1682 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:49.737231 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-2059d9ab-a840-4bc0-8346-a1e0fc30c17d tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:49.737853 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-2059d9ab-a840-4bc0-8346-a1e0fc30c17d tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] [instance: ad989c34-1973-42cb-82ea-637973bf8d4f] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:49.745021 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-2059d9ab-a840-4bc0-8346-a1e0fc30c17d tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:49.745503 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-2059d9ab-a840-4bc0-8346-a1e0fc30c17d tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:49.745939 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-2059d9ab-a840-4bc0-8346-a1e0fc30c17d tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:49.746638 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-2059d9ab-a840-4bc0-8346-a1e0fc30c17d tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:49.747091 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-2059d9ab-a840-4bc0-8346-a1e0fc30c17d tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:49.747510 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-2059d9ab-a840-4bc0-8346-a1e0fc30c17d tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:49.895147 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-2059d9ab-a840-4bc0-8346-a1e0fc30c17d tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2771d02bec4465d94e98134015b9705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1659fef961ae4ccda1adf6b62c018c9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:49.904407 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-2059d9ab-a840-4bc0-8346-a1e0fc30c17d tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] 10.222.0.52 "GET /compute/v2.1/servers/ad989c34-1973-42cb-82ea-637973bf8d4f" status: 200 len: 1359 microversion: 2.1 time: 0.171384 Oct 28 09:55:49.905327 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 409/833] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:49 2022] GET /compute/v2.1/servers/ad989c34-1973-42cb-82ea-637973bf8d4f => generated 1359 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:50.659879 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-e4803bfa-fd66-4a58-adf2-da4eadc7dc5b tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:50.660773 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-e4803bfa-fd66-4a58-adf2-da4eadc7dc5b tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] [instance: 91ca6322-9cdc-4106-8021-811be2c4af7f] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:50.667598 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-e4803bfa-fd66-4a58-adf2-da4eadc7dc5b tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:50.668120 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-e4803bfa-fd66-4a58-adf2-da4eadc7dc5b tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:50.668555 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-e4803bfa-fd66-4a58-adf2-da4eadc7dc5b tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:50.669258 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-e4803bfa-fd66-4a58-adf2-da4eadc7dc5b tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:50.669717 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-e4803bfa-fd66-4a58-adf2-da4eadc7dc5b tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:50.670137 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-e4803bfa-fd66-4a58-adf2-da4eadc7dc5b tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:50.808387 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-e4803bfa-fd66-4a58-adf2-da4eadc7dc5b tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38ce75423b5412d90c1158396978b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e60d7c624e49e1bb43188ae9d7dd2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:50.817597 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-e4803bfa-fd66-4a58-adf2-da4eadc7dc5b tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] 10.222.0.52 "GET /compute/v2.1/servers/91ca6322-9cdc-4106-8021-811be2c4af7f" status: 200 len: 1682 microversion: 2.1 time: 0.162898 Oct 28 09:55:50.818269 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 425/834] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:50 2022] GET /compute/v2.1/servers/91ca6322-9cdc-4106-8021-811be2c4af7f => generated 1682 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:50.926487 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-18edca31-c92e-4033-948d-ddc8d8a96e9c tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:50.927131 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-18edca31-c92e-4033-948d-ddc8d8a96e9c tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] [instance: ad989c34-1973-42cb-82ea-637973bf8d4f] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:50.933608 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-18edca31-c92e-4033-948d-ddc8d8a96e9c tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:50.934343 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-18edca31-c92e-4033-948d-ddc8d8a96e9c tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:50.934841 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-18edca31-c92e-4033-948d-ddc8d8a96e9c tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:50.935582 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-18edca31-c92e-4033-948d-ddc8d8a96e9c tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:50.936083 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-18edca31-c92e-4033-948d-ddc8d8a96e9c tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:50.936783 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-18edca31-c92e-4033-948d-ddc8d8a96e9c tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:51.081574 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-18edca31-c92e-4033-948d-ddc8d8a96e9c tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2771d02bec4465d94e98134015b9705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1659fef961ae4ccda1adf6b62c018c9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:51.089352 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-18edca31-c92e-4033-948d-ddc8d8a96e9c tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] 10.222.0.52 "GET /compute/v2.1/servers/ad989c34-1973-42cb-82ea-637973bf8d4f" status: 200 len: 1359 microversion: 2.1 time: 0.166728 Oct 28 09:55:51.089927 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 410/835] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:50 2022] GET /compute/v2.1/servers/ad989c34-1973-42cb-82ea-637973bf8d4f => generated 1359 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:55:51.841997 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-c6e39a65-341e-4c5c-9672-ee0e30c4ad6c tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:51.842798 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-c6e39a65-341e-4c5c-9672-ee0e30c4ad6c tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] [instance: 91ca6322-9cdc-4106-8021-811be2c4af7f] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:51.849526 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-c6e39a65-341e-4c5c-9672-ee0e30c4ad6c tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:51.850350 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-c6e39a65-341e-4c5c-9672-ee0e30c4ad6c tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:51.851003 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-c6e39a65-341e-4c5c-9672-ee0e30c4ad6c tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:51.851982 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-c6e39a65-341e-4c5c-9672-ee0e30c4ad6c tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:51.852832 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-c6e39a65-341e-4c5c-9672-ee0e30c4ad6c tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:51.853472 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-c6e39a65-341e-4c5c-9672-ee0e30c4ad6c tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:51.994045 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-c6e39a65-341e-4c5c-9672-ee0e30c4ad6c tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38ce75423b5412d90c1158396978b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e60d7c624e49e1bb43188ae9d7dd2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:52.002734 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-c6e39a65-341e-4c5c-9672-ee0e30c4ad6c tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] 10.222.0.52 "GET /compute/v2.1/servers/91ca6322-9cdc-4106-8021-811be2c4af7f" status: 200 len: 1682 microversion: 2.1 time: 0.164563 Oct 28 09:55:52.003568 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 426/836] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:51 2022] GET /compute/v2.1/servers/91ca6322-9cdc-4106-8021-811be2c4af7f => generated 1682 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:52.113355 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-5d786f58-82ff-4986-9bbb-b4f56575f6d9 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:52.114712 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-5d786f58-82ff-4986-9bbb-b4f56575f6d9 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] [instance: ad989c34-1973-42cb-82ea-637973bf8d4f] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:52.121497 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-5d786f58-82ff-4986-9bbb-b4f56575f6d9 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:52.121968 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-5d786f58-82ff-4986-9bbb-b4f56575f6d9 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:52.122400 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-5d786f58-82ff-4986-9bbb-b4f56575f6d9 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:52.123097 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-5d786f58-82ff-4986-9bbb-b4f56575f6d9 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:52.123662 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-5d786f58-82ff-4986-9bbb-b4f56575f6d9 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:52.124122 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-5d786f58-82ff-4986-9bbb-b4f56575f6d9 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:52.278321 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-5d786f58-82ff-4986-9bbb-b4f56575f6d9 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2771d02bec4465d94e98134015b9705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1659fef961ae4ccda1adf6b62c018c9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:52.286700 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-5d786f58-82ff-4986-9bbb-b4f56575f6d9 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] 10.222.0.52 "GET /compute/v2.1/servers/ad989c34-1973-42cb-82ea-637973bf8d4f" status: 200 len: 1359 microversion: 2.1 time: 0.177318 Oct 28 09:55:52.299847 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 411/837] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:52 2022] GET /compute/v2.1/servers/ad989c34-1973-42cb-82ea-637973bf8d4f => generated 1359 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:53.028301 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-3359f6bb-a861-4375-8957-790b7a2880e5 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:53.028889 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-3359f6bb-a861-4375-8957-790b7a2880e5 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] [instance: 91ca6322-9cdc-4106-8021-811be2c4af7f] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:53.035550 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-3359f6bb-a861-4375-8957-790b7a2880e5 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:53.036067 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-3359f6bb-a861-4375-8957-790b7a2880e5 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:53.036497 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-3359f6bb-a861-4375-8957-790b7a2880e5 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:53.037196 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-3359f6bb-a861-4375-8957-790b7a2880e5 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:53.037648 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-3359f6bb-a861-4375-8957-790b7a2880e5 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:53.038067 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-3359f6bb-a861-4375-8957-790b7a2880e5 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:53.180854 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-3359f6bb-a861-4375-8957-790b7a2880e5 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38ce75423b5412d90c1158396978b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e60d7c624e49e1bb43188ae9d7dd2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:53.188648 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-3359f6bb-a861-4375-8957-790b7a2880e5 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] 10.222.0.52 "GET /compute/v2.1/servers/91ca6322-9cdc-4106-8021-811be2c4af7f" status: 200 len: 1682 microversion: 2.1 time: 0.165581 Oct 28 09:55:53.190021 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 427/838] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:53 2022] GET /compute/v2.1/servers/91ca6322-9cdc-4106-8021-811be2c4af7f => generated 1682 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:53.310983 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-adbc80aa-42a4-42aa-ae26-a7bbfc2a02ea tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:53.311567 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-adbc80aa-42a4-42aa-ae26-a7bbfc2a02ea tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] [instance: ad989c34-1973-42cb-82ea-637973bf8d4f] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:53.318365 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-adbc80aa-42a4-42aa-ae26-a7bbfc2a02ea tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:53.318876 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-adbc80aa-42a4-42aa-ae26-a7bbfc2a02ea tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:53.319304 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-adbc80aa-42a4-42aa-ae26-a7bbfc2a02ea tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:53.320126 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-adbc80aa-42a4-42aa-ae26-a7bbfc2a02ea tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:53.320573 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-adbc80aa-42a4-42aa-ae26-a7bbfc2a02ea tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:53.321003 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-adbc80aa-42a4-42aa-ae26-a7bbfc2a02ea tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:53.478238 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-adbc80aa-42a4-42aa-ae26-a7bbfc2a02ea tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2771d02bec4465d94e98134015b9705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1659fef961ae4ccda1adf6b62c018c9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:53.486606 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-adbc80aa-42a4-42aa-ae26-a7bbfc2a02ea tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] 10.222.0.52 "GET /compute/v2.1/servers/ad989c34-1973-42cb-82ea-637973bf8d4f" status: 200 len: 1359 microversion: 2.1 time: 0.179173 Oct 28 09:55:53.502421 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 412/839] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:53 2022] GET /compute/v2.1/servers/ad989c34-1973-42cb-82ea-637973bf8d4f => generated 1359 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:54.212817 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-f862a79c-42a5-464b-958a-a3d2fd30602d tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:54.213434 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-f862a79c-42a5-464b-958a-a3d2fd30602d tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] [instance: 91ca6322-9cdc-4106-8021-811be2c4af7f] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:54.219878 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-f862a79c-42a5-464b-958a-a3d2fd30602d tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:54.220367 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-f862a79c-42a5-464b-958a-a3d2fd30602d tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:54.220810 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-f862a79c-42a5-464b-958a-a3d2fd30602d tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:54.221563 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-f862a79c-42a5-464b-958a-a3d2fd30602d tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:54.222027 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-f862a79c-42a5-464b-958a-a3d2fd30602d tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:54.222489 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-f862a79c-42a5-464b-958a-a3d2fd30602d tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:54.388308 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-f862a79c-42a5-464b-958a-a3d2fd30602d tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38ce75423b5412d90c1158396978b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e60d7c624e49e1bb43188ae9d7dd2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:54.397222 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-f862a79c-42a5-464b-958a-a3d2fd30602d tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] 10.222.0.52 "GET /compute/v2.1/servers/91ca6322-9cdc-4106-8021-811be2c4af7f" status: 200 len: 1682 microversion: 2.1 time: 0.188236 Oct 28 09:55:54.397805 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 428/840] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:54 2022] GET /compute/v2.1/servers/91ca6322-9cdc-4106-8021-811be2c4af7f => generated 1682 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:55:54.509921 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-9d334848-2ed8-486a-83a9-352809390495 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:54.510552 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-9d334848-2ed8-486a-83a9-352809390495 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] [instance: ad989c34-1973-42cb-82ea-637973bf8d4f] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:54.518007 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-9d334848-2ed8-486a-83a9-352809390495 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:54.518628 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-9d334848-2ed8-486a-83a9-352809390495 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:54.519071 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-9d334848-2ed8-486a-83a9-352809390495 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:54.519797 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-9d334848-2ed8-486a-83a9-352809390495 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:54.520444 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-9d334848-2ed8-486a-83a9-352809390495 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:54.520916 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-9d334848-2ed8-486a-83a9-352809390495 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:54.667590 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-9d334848-2ed8-486a-83a9-352809390495 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2771d02bec4465d94e98134015b9705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1659fef961ae4ccda1adf6b62c018c9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:54.675535 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-9d334848-2ed8-486a-83a9-352809390495 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] 10.222.0.52 "GET /compute/v2.1/servers/ad989c34-1973-42cb-82ea-637973bf8d4f" status: 200 len: 1359 microversion: 2.1 time: 0.169366 Oct 28 09:55:54.676280 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 413/841] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:54 2022] GET /compute/v2.1/servers/ad989c34-1973-42cb-82ea-637973bf8d4f => generated 1359 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:55.421903 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-13fdc10e-f561-430a-afa1-58805df2947b tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:55.422503 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-13fdc10e-f561-430a-afa1-58805df2947b tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] [instance: 91ca6322-9cdc-4106-8021-811be2c4af7f] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:55.424901 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG dbcounter [-] [127032] Writing DB stats nova_cell0:SELECT=2 {{(pid=127032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:55:55.425716 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG dbcounter [-] [127032] Writing DB stats nova_cell0:SELECT=6 {{(pid=127032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:55:55.431668 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-13fdc10e-f561-430a-afa1-58805df2947b tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:55.432171 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-13fdc10e-f561-430a-afa1-58805df2947b tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:55.432601 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-13fdc10e-f561-430a-afa1-58805df2947b tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:55.433280 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-13fdc10e-f561-430a-afa1-58805df2947b tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:55.433728 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-13fdc10e-f561-430a-afa1-58805df2947b tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:55.434144 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-13fdc10e-f561-430a-afa1-58805df2947b tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:55.565572 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-13fdc10e-f561-430a-afa1-58805df2947b tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38ce75423b5412d90c1158396978b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e60d7c624e49e1bb43188ae9d7dd2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:55.573331 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-13fdc10e-f561-430a-afa1-58805df2947b tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] 10.222.0.52 "GET /compute/v2.1/servers/91ca6322-9cdc-4106-8021-811be2c4af7f" status: 200 len: 1682 microversion: 2.1 time: 0.155325 Oct 28 09:55:55.573892 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 429/842] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:55 2022] GET /compute/v2.1/servers/91ca6322-9cdc-4106-8021-811be2c4af7f => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:55.698456 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-c4d0c18f-5116-4388-b45a-3a53612715f2 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:55.699071 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-c4d0c18f-5116-4388-b45a-3a53612715f2 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] [instance: ad989c34-1973-42cb-82ea-637973bf8d4f] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:55.701054 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG dbcounter [-] [127033] Writing DB stats nova_cell0:SELECT=6 {{(pid=127033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:55:55.706616 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-c4d0c18f-5116-4388-b45a-3a53612715f2 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:55.707104 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-c4d0c18f-5116-4388-b45a-3a53612715f2 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:55.707560 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-c4d0c18f-5116-4388-b45a-3a53612715f2 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:55.708256 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-c4d0c18f-5116-4388-b45a-3a53612715f2 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:55.708712 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-c4d0c18f-5116-4388-b45a-3a53612715f2 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:55.709134 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-c4d0c18f-5116-4388-b45a-3a53612715f2 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:55.838891 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-c4d0c18f-5116-4388-b45a-3a53612715f2 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2771d02bec4465d94e98134015b9705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1659fef961ae4ccda1adf6b62c018c9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:55.847315 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-c4d0c18f-5116-4388-b45a-3a53612715f2 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] 10.222.0.52 "GET /compute/v2.1/servers/ad989c34-1973-42cb-82ea-637973bf8d4f" status: 200 len: 1359 microversion: 2.1 time: 0.152731 Oct 28 09:55:55.847910 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 414/843] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:55 2022] GET /compute/v2.1/servers/ad989c34-1973-42cb-82ea-637973bf8d4f => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:56.596826 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-ae09c031-d102-4aca-9f83-fb0c783449db tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:56.597434 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-ae09c031-d102-4aca-9f83-fb0c783449db tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] [instance: 91ca6322-9cdc-4106-8021-811be2c4af7f] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:56.603986 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ae09c031-d102-4aca-9f83-fb0c783449db tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:56.604473 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ae09c031-d102-4aca-9f83-fb0c783449db tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:56.604916 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ae09c031-d102-4aca-9f83-fb0c783449db tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:56.605606 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ae09c031-d102-4aca-9f83-fb0c783449db tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:56.606065 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ae09c031-d102-4aca-9f83-fb0c783449db tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:56.606490 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ae09c031-d102-4aca-9f83-fb0c783449db tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:56.737575 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-ae09c031-d102-4aca-9f83-fb0c783449db tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38ce75423b5412d90c1158396978b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e60d7c624e49e1bb43188ae9d7dd2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:56.745440 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-ae09c031-d102-4aca-9f83-fb0c783449db tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] 10.222.0.52 "GET /compute/v2.1/servers/91ca6322-9cdc-4106-8021-811be2c4af7f" status: 200 len: 1682 microversion: 2.1 time: 0.153120 Oct 28 09:55:56.746003 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 430/844] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:56 2022] GET /compute/v2.1/servers/91ca6322-9cdc-4106-8021-811be2c4af7f => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:56.870460 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-e6de3211-75e7-4a75-9991-196fbad61bed tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:56.871068 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-e6de3211-75e7-4a75-9991-196fbad61bed tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] [instance: ad989c34-1973-42cb-82ea-637973bf8d4f] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:56.877480 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-e6de3211-75e7-4a75-9991-196fbad61bed tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:56.877963 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-e6de3211-75e7-4a75-9991-196fbad61bed tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:56.878397 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-e6de3211-75e7-4a75-9991-196fbad61bed tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:56.879081 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-e6de3211-75e7-4a75-9991-196fbad61bed tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:56.879533 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-e6de3211-75e7-4a75-9991-196fbad61bed tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:56.879981 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-e6de3211-75e7-4a75-9991-196fbad61bed tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:57.009758 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-e6de3211-75e7-4a75-9991-196fbad61bed tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2771d02bec4465d94e98134015b9705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1659fef961ae4ccda1adf6b62c018c9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:57.018057 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-e6de3211-75e7-4a75-9991-196fbad61bed tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] 10.222.0.52 "GET /compute/v2.1/servers/ad989c34-1973-42cb-82ea-637973bf8d4f" status: 200 len: 1359 microversion: 2.1 time: 0.151170 Oct 28 09:55:57.018624 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 415/845] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:56 2022] GET /compute/v2.1/servers/ad989c34-1973-42cb-82ea-637973bf8d4f => generated 1359 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:57.768556 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-77857d22-42bc-40e6-b20a-10daaf466076 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:57.769156 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-77857d22-42bc-40e6-b20a-10daaf466076 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] [instance: 91ca6322-9cdc-4106-8021-811be2c4af7f] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:57.775578 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-77857d22-42bc-40e6-b20a-10daaf466076 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:57.776099 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-77857d22-42bc-40e6-b20a-10daaf466076 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:57.776540 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-77857d22-42bc-40e6-b20a-10daaf466076 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:57.777229 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-77857d22-42bc-40e6-b20a-10daaf466076 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:57.777685 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-77857d22-42bc-40e6-b20a-10daaf466076 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:57.778112 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-77857d22-42bc-40e6-b20a-10daaf466076 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:57.905065 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-77857d22-42bc-40e6-b20a-10daaf466076 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38ce75423b5412d90c1158396978b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e60d7c624e49e1bb43188ae9d7dd2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:57.913217 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-77857d22-42bc-40e6-b20a-10daaf466076 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] 10.222.0.52 "GET /compute/v2.1/servers/91ca6322-9cdc-4106-8021-811be2c4af7f" status: 200 len: 1682 microversion: 2.1 time: 0.148539 Oct 28 09:55:57.913787 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 431/846] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:57 2022] GET /compute/v2.1/servers/91ca6322-9cdc-4106-8021-811be2c4af7f => generated 1682 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:58.040896 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-84eaedb4-7e2a-447b-8c70-8766354a9a65 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:58.041449 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-84eaedb4-7e2a-447b-8c70-8766354a9a65 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] [instance: ad989c34-1973-42cb-82ea-637973bf8d4f] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:58.049752 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-84eaedb4-7e2a-447b-8c70-8766354a9a65 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:58.050234 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-84eaedb4-7e2a-447b-8c70-8766354a9a65 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:58.050686 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-84eaedb4-7e2a-447b-8c70-8766354a9a65 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:58.051374 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-84eaedb4-7e2a-447b-8c70-8766354a9a65 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:58.051843 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-84eaedb4-7e2a-447b-8c70-8766354a9a65 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:58.052258 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-84eaedb4-7e2a-447b-8c70-8766354a9a65 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:58.182557 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-84eaedb4-7e2a-447b-8c70-8766354a9a65 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2771d02bec4465d94e98134015b9705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1659fef961ae4ccda1adf6b62c018c9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:58.190175 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-84eaedb4-7e2a-447b-8c70-8766354a9a65 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] 10.222.0.52 "GET /compute/v2.1/servers/ad989c34-1973-42cb-82ea-637973bf8d4f" status: 200 len: 1359 microversion: 2.1 time: 0.153171 Oct 28 09:55:58.190732 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 416/847] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:58 2022] GET /compute/v2.1/servers/ad989c34-1973-42cb-82ea-637973bf8d4f => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:58.937874 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-5b6e0b1f-cc16-4b32-b8ba-adcb3f9bad7c tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:58.939200 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-5b6e0b1f-cc16-4b32-b8ba-adcb3f9bad7c tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] [instance: 91ca6322-9cdc-4106-8021-811be2c4af7f] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:58.946977 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-5b6e0b1f-cc16-4b32-b8ba-adcb3f9bad7c tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:58.947470 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-5b6e0b1f-cc16-4b32-b8ba-adcb3f9bad7c tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:58.948413 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-5b6e0b1f-cc16-4b32-b8ba-adcb3f9bad7c tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:58.948995 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-5b6e0b1f-cc16-4b32-b8ba-adcb3f9bad7c tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:58.949461 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-5b6e0b1f-cc16-4b32-b8ba-adcb3f9bad7c tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:58.949887 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-5b6e0b1f-cc16-4b32-b8ba-adcb3f9bad7c tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:59.083478 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-5b6e0b1f-cc16-4b32-b8ba-adcb3f9bad7c tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38ce75423b5412d90c1158396978b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e60d7c624e49e1bb43188ae9d7dd2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:59.091619 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-5b6e0b1f-cc16-4b32-b8ba-adcb3f9bad7c tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] 10.222.0.52 "GET /compute/v2.1/servers/91ca6322-9cdc-4106-8021-811be2c4af7f" status: 200 len: 1682 microversion: 2.1 time: 0.158653 Oct 28 09:55:59.092274 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 432/848] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:58 2022] GET /compute/v2.1/servers/91ca6322-9cdc-4106-8021-811be2c4af7f => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:59.213736 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-ec3abf31-0e3f-4bde-8dad-767d63655597 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:59.214283 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-ec3abf31-0e3f-4bde-8dad-767d63655597 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] [instance: ad989c34-1973-42cb-82ea-637973bf8d4f] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:59.220593 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-ec3abf31-0e3f-4bde-8dad-767d63655597 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:59.221088 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-ec3abf31-0e3f-4bde-8dad-767d63655597 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:59.222121 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-ec3abf31-0e3f-4bde-8dad-767d63655597 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:59.222814 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-ec3abf31-0e3f-4bde-8dad-767d63655597 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:59.223272 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-ec3abf31-0e3f-4bde-8dad-767d63655597 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:59.223704 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-ec3abf31-0e3f-4bde-8dad-767d63655597 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:59.357462 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-ec3abf31-0e3f-4bde-8dad-767d63655597 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2771d02bec4465d94e98134015b9705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1659fef961ae4ccda1adf6b62c018c9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:59.365840 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-ec3abf31-0e3f-4bde-8dad-767d63655597 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] 10.222.0.52 "GET /compute/v2.1/servers/ad989c34-1973-42cb-82ea-637973bf8d4f" status: 200 len: 1359 microversion: 2.1 time: 0.156102 Oct 28 09:55:59.366409 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 417/849] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:59 2022] GET /compute/v2.1/servers/ad989c34-1973-42cb-82ea-637973bf8d4f => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:59.589176 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [req-426907a0-9256-4307-bde6-b052fe6866ab req-bae3fe1e-4bf2-4c33-8610-041313999ef1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad989c34-1973-42cb-82ea-637973bf8d4f", "tag": "543772b3-bb29-406f-b183-de6fa81a0980"}]} {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:55:59.600750 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-426907a0-9256-4307-bde6-b052fe6866ab req-bae3fe1e-4bf2-4c33-8610-041313999ef1 service nova] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:59.601728 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-426907a0-9256-4307-bde6-b052fe6866ab req-bae3fe1e-4bf2-4c33-8610-041313999ef1 service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:59.602383 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-426907a0-9256-4307-bde6-b052fe6866ab req-bae3fe1e-4bf2-4c33-8610-041313999ef1 service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:59.614661 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.compute.server_external_events [req-426907a0-9256-4307-bde6-b052fe6866ab req-bae3fe1e-4bf2-4c33-8610-041313999ef1 service nova] Creating event network-changed:543772b3-bb29-406f-b183-de6fa81a0980 for instance ad989c34-1973-42cb-82ea-637973bf8d4f on hv-cinder-zed-3 Oct 28 09:55:59.619561 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [req-426907a0-9256-4307-bde6-b052fe6866ab req-bae3fe1e-4bf2-4c33-8610-041313999ef1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035574 Oct 28 09:55:59.620698 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 433/850] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Oct 28 09:55:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:56:00.126998 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-1a6c2920-c735-44ee-98f1-3a0367a763cf tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:00.128657 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-1a6c2920-c735-44ee-98f1-3a0367a763cf tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] [instance: 91ca6322-9cdc-4106-8021-811be2c4af7f] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:00.135941 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-1a6c2920-c735-44ee-98f1-3a0367a763cf tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:00.136442 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-1a6c2920-c735-44ee-98f1-3a0367a763cf tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:00.136877 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-1a6c2920-c735-44ee-98f1-3a0367a763cf tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:00.137617 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-1a6c2920-c735-44ee-98f1-3a0367a763cf tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:00.138042 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-1a6c2920-c735-44ee-98f1-3a0367a763cf tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:00.138469 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-1a6c2920-c735-44ee-98f1-3a0367a763cf tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:00.226978 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-1a6c2920-c735-44ee-98f1-3a0367a763cf tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38ce75423b5412d90c1158396978b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e60d7c624e49e1bb43188ae9d7dd2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:00.237159 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-1a6c2920-c735-44ee-98f1-3a0367a763cf tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] 10.222.0.52 "GET /compute/v2.1/servers/91ca6322-9cdc-4106-8021-811be2c4af7f" status: 200 len: 1614 microversion: 2.1 time: 0.126396 Oct 28 09:56:00.237764 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 418/851] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:00 2022] GET /compute/v2.1/servers/91ca6322-9cdc-4106-8021-811be2c4af7f => generated 1614 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:00.390347 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-24d1df4a-3dec-42d2-b829-304789d71267 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:00.391136 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-24d1df4a-3dec-42d2-b829-304789d71267 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] [instance: ad989c34-1973-42cb-82ea-637973bf8d4f] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:00.397336 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-24d1df4a-3dec-42d2-b829-304789d71267 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:00.397816 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-24d1df4a-3dec-42d2-b829-304789d71267 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:00.398240 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-24d1df4a-3dec-42d2-b829-304789d71267 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:00.399066 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-24d1df4a-3dec-42d2-b829-304789d71267 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:00.399516 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-24d1df4a-3dec-42d2-b829-304789d71267 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:00.399970 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-24d1df4a-3dec-42d2-b829-304789d71267 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:00.537821 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-24d1df4a-3dec-42d2-b829-304789d71267 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2771d02bec4465d94e98134015b9705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1659fef961ae4ccda1adf6b62c018c9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:00.545636 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-24d1df4a-3dec-42d2-b829-304789d71267 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] 10.222.0.52 "GET /compute/v2.1/servers/ad989c34-1973-42cb-82ea-637973bf8d4f" status: 200 len: 1359 microversion: 2.1 time: 0.160007 Oct 28 09:56:00.546212 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 434/852] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:00 2022] GET /compute/v2.1/servers/ad989c34-1973-42cb-82ea-637973bf8d4f => generated 1359 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:01.262253 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-e99d9e65-a16f-4ac1-b0f9-6f7d88342d25 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:01.262864 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-e99d9e65-a16f-4ac1-b0f9-6f7d88342d25 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] [instance: 91ca6322-9cdc-4106-8021-811be2c4af7f] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:01.269973 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-e99d9e65-a16f-4ac1-b0f9-6f7d88342d25 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:01.270459 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-e99d9e65-a16f-4ac1-b0f9-6f7d88342d25 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:01.270888 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-e99d9e65-a16f-4ac1-b0f9-6f7d88342d25 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:01.271573 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-e99d9e65-a16f-4ac1-b0f9-6f7d88342d25 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:01.272022 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-e99d9e65-a16f-4ac1-b0f9-6f7d88342d25 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:01.272491 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-e99d9e65-a16f-4ac1-b0f9-6f7d88342d25 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:01.304141 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-e99d9e65-a16f-4ac1-b0f9-6f7d88342d25 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:01.304632 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-e99d9e65-a16f-4ac1-b0f9-6f7d88342d25 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:01.305069 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-e99d9e65-a16f-4ac1-b0f9-6f7d88342d25 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:01.305516 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.objects.instance [None req-e99d9e65-a16f-4ac1-b0f9-6f7d88342d25 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lazy-loading 'fault' on Instance uuid 91ca6322-9cdc-4106-8021-811be2c4af7f {{(pid=127033) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:56:01.349262 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-e99d9e65-a16f-4ac1-b0f9-6f7d88342d25 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38ce75423b5412d90c1158396978b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e60d7c624e49e1bb43188ae9d7dd2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:01.352670 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG dbcounter [-] [127033] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:56:01.357833 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-e99d9e65-a16f-4ac1-b0f9-6f7d88342d25 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] 10.222.0.52 "GET /compute/v2.1/servers/91ca6322-9cdc-4106-8021-811be2c4af7f" status: 200 len: 1331 microversion: 2.1 time: 0.099487 Oct 28 09:56:01.358408 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 419/853] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:01 2022] GET /compute/v2.1/servers/91ca6322-9cdc-4106-8021-811be2c4af7f => generated 1331 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:01.568739 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-a29f161a-21c8-4e33-aa9f-e3caeb164802 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:01.569406 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-a29f161a-21c8-4e33-aa9f-e3caeb164802 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] [instance: ad989c34-1973-42cb-82ea-637973bf8d4f] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:01.575881 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-a29f161a-21c8-4e33-aa9f-e3caeb164802 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:01.576370 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-a29f161a-21c8-4e33-aa9f-e3caeb164802 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:01.576807 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-a29f161a-21c8-4e33-aa9f-e3caeb164802 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:01.577503 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-a29f161a-21c8-4e33-aa9f-e3caeb164802 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:01.577963 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-a29f161a-21c8-4e33-aa9f-e3caeb164802 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:01.578387 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-a29f161a-21c8-4e33-aa9f-e3caeb164802 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:01.636192 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [req-494f9407-63b8-4a44-9e67-7362c5259ef0 req-73827535-d4f6-47af-a488-91ffa9cecceb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91ca6322-9cdc-4106-8021-811be2c4af7f", "name": "network-vif-deleted", "tag": "1cfbcd30-0147-4e20-82fe-3a1b33dcf67f"}]} {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:56:01.647535 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-494f9407-63b8-4a44-9e67-7362c5259ef0 req-73827535-d4f6-47af-a488-91ffa9cecceb service nova] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:01.648038 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-494f9407-63b8-4a44-9e67-7362c5259ef0 req-73827535-d4f6-47af-a488-91ffa9cecceb service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:01.648466 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-494f9407-63b8-4a44-9e67-7362c5259ef0 req-73827535-d4f6-47af-a488-91ffa9cecceb service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:01.660816 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.compute.server_external_events [req-494f9407-63b8-4a44-9e67-7362c5259ef0 req-73827535-d4f6-47af-a488-91ffa9cecceb service nova] Creating event network-vif-deleted:1cfbcd30-0147-4e20-82fe-3a1b33dcf67f for instance 91ca6322-9cdc-4106-8021-811be2c4af7f on hv-cinder-zed-3 Oct 28 09:56:01.665815 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [req-494f9407-63b8-4a44-9e67-7362c5259ef0 req-73827535-d4f6-47af-a488-91ffa9cecceb service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033244 Oct 28 09:56:01.666414 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 420/854] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Oct 28 09:56:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 09:56:01.709940 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-a29f161a-21c8-4e33-aa9f-e3caeb164802 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2771d02bec4465d94e98134015b9705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1659fef961ae4ccda1adf6b62c018c9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:01.717478 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-a29f161a-21c8-4e33-aa9f-e3caeb164802 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] 10.222.0.52 "GET /compute/v2.1/servers/ad989c34-1973-42cb-82ea-637973bf8d4f" status: 200 len: 1359 microversion: 2.1 time: 0.153183 Oct 28 09:56:01.718045 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 435/855] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:01 2022] GET /compute/v2.1/servers/ad989c34-1973-42cb-82ea-637973bf8d4f => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:02.384873 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-d846ea85-abe9-4246-bfeb-8f205999d1db tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:02.386302 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-d846ea85-abe9-4246-bfeb-8f205999d1db tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] [instance: 91ca6322-9cdc-4106-8021-811be2c4af7f] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:02.392934 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-d846ea85-abe9-4246-bfeb-8f205999d1db tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:02.393680 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-d846ea85-abe9-4246-bfeb-8f205999d1db tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:02.394291 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-d846ea85-abe9-4246-bfeb-8f205999d1db tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:02.399590 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-d846ea85-abe9-4246-bfeb-8f205999d1db tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:02.400191 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-d846ea85-abe9-4246-bfeb-8f205999d1db tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:02.400698 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-d846ea85-abe9-4246-bfeb-8f205999d1db tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:02.435686 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-d846ea85-abe9-4246-bfeb-8f205999d1db tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:02.436206 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-d846ea85-abe9-4246-bfeb-8f205999d1db tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:02.436796 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-d846ea85-abe9-4246-bfeb-8f205999d1db tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:02.437277 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.objects.instance [None req-d846ea85-abe9-4246-bfeb-8f205999d1db tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lazy-loading 'fault' on Instance uuid 91ca6322-9cdc-4106-8021-811be2c4af7f {{(pid=127033) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:56:02.480824 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-d846ea85-abe9-4246-bfeb-8f205999d1db tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38ce75423b5412d90c1158396978b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e60d7c624e49e1bb43188ae9d7dd2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:02.489044 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-d846ea85-abe9-4246-bfeb-8f205999d1db tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] 10.222.0.52 "GET /compute/v2.1/servers/91ca6322-9cdc-4106-8021-811be2c4af7f" status: 200 len: 1331 microversion: 2.1 time: 0.111912 Oct 28 09:56:02.489626 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 421/856] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:02 2022] GET /compute/v2.1/servers/91ca6322-9cdc-4106-8021-811be2c4af7f => generated 1331 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:02.741452 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-d74bac8c-200a-494b-a303-fbaa287c992c tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:02.742067 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-d74bac8c-200a-494b-a303-fbaa287c992c tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] [instance: ad989c34-1973-42cb-82ea-637973bf8d4f] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:02.749816 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-d74bac8c-200a-494b-a303-fbaa287c992c tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:02.750311 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-d74bac8c-200a-494b-a303-fbaa287c992c tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:02.751174 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-d74bac8c-200a-494b-a303-fbaa287c992c tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:02.751922 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-d74bac8c-200a-494b-a303-fbaa287c992c tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:02.752383 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-d74bac8c-200a-494b-a303-fbaa287c992c tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:02.752868 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-d74bac8c-200a-494b-a303-fbaa287c992c tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:02.898410 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-d74bac8c-200a-494b-a303-fbaa287c992c tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2771d02bec4465d94e98134015b9705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1659fef961ae4ccda1adf6b62c018c9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:02.901973 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG dbcounter [-] [127032] Writing DB stats nova_cell1:SELECT=100 {{(pid=127032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:56:02.907129 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-d74bac8c-200a-494b-a303-fbaa287c992c tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] 10.222.0.52 "GET /compute/v2.1/servers/ad989c34-1973-42cb-82ea-637973bf8d4f" status: 200 len: 1359 microversion: 2.1 time: 0.170637 Oct 28 09:56:02.907714 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 436/857] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:02 2022] GET /compute/v2.1/servers/ad989c34-1973-42cb-82ea-637973bf8d4f => generated 1359 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:03.512757 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-247a4e1b-cb75-46f2-99c1-aeefc56fab55 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:03.513305 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-247a4e1b-cb75-46f2-99c1-aeefc56fab55 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] [instance: 91ca6322-9cdc-4106-8021-811be2c4af7f] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:03.519790 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-247a4e1b-cb75-46f2-99c1-aeefc56fab55 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:03.520290 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-247a4e1b-cb75-46f2-99c1-aeefc56fab55 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:03.520728 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-247a4e1b-cb75-46f2-99c1-aeefc56fab55 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:03.521432 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-247a4e1b-cb75-46f2-99c1-aeefc56fab55 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:03.521890 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-247a4e1b-cb75-46f2-99c1-aeefc56fab55 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:03.522318 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-247a4e1b-cb75-46f2-99c1-aeefc56fab55 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:03.536781 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.wsgi [None req-247a4e1b-cb75-46f2-99c1-aeefc56fab55 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] HTTP exception thrown: Instance 91ca6322-9cdc-4106-8021-811be2c4af7f could not be found. Oct 28 09:56:03.538465 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-247a4e1b-cb75-46f2-99c1-aeefc56fab55 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Request method failure captured: Oct 28 09:56:03.538465 dv-cinder-zed-3-smb devstack@n-api.service[127033]: request: GET /compute/v2.1/servers/91ca6322-9cdc-4106-8021-811be2c4af7f HTTP/1.1 Oct 28 09:56:03.538465 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Accept: application/json Oct 28 09:56:03.538465 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Accept-Encoding: identity Oct 28 09:56:03.538465 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Connection: close Oct 28 09:56:03.538465 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Content-Length: 0 Oct 28 09:56:03.538465 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Content-Type: application/json Oct 28 09:56:03.538465 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Host: 10.222.0.52 Oct 28 09:56:03.538465 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Openstack-System-Scope: None Oct 28 09:56:03.538465 dv-cinder-zed-3-smb devstack@n-api.service[127033]: User-Agent: python-urllib3/1.26.12 Oct 28 09:56:03.538465 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Auth-Token: gAAAAABjW6ZlB_y8UlHttqFpTZf-FQqNFL8UpqBADpRqoMnMvW_jAoL6f5CF8d3TJuqshSrx4zOxOgPBQaaPIBzA2l5d4VliO6WO9dxAWAz2QeafoRTcYtg1CKFv-cJOUbVbMelTlyaihpwFtFOGoW8EkNwvlaaR3DGtxA3ButWLQbGRra0UmvI Oct 28 09:56:03.538465 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Domain-Id: None Oct 28 09:56:03.538465 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Domain-Name: None Oct 28 09:56:03.538465 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Identity-Status: Confirmed Oct 28 09:56:03.538465 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Is-Admin-Project: True Oct 28 09:56:03.538465 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Project-Domain-Id: default Oct 28 09:56:03.538465 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Project-Domain-Name: Default Oct 28 09:56:03.538465 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Project-Id: 68e60d7c624e49e1bb43188ae9d7dd2b Oct 28 09:56:03.538465 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Project-Name: tempest-AttachVolumeNegativeTest-21111899 Oct 28 09:56:03.538465 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Role: reader,member Oct 28 09:56:03.538465 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Roles: reader,member Oct 28 09:56:03.540170 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_68e60d7c624e49e1bb43188ae9d7dd2b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/68e60d7c624e49e1bb43188ae9d7dd2b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/68e60d7c624e49e1bb43188ae9d7dd2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/68e60d7c624e49e1bb43188ae9d7dd2b"}]}] Oct 28 09:56:03.540170 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Tenant: tempest-AttachVolumeNegativeTest-21111899 Oct 28 09:56:03.540170 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Tenant-Id: 68e60d7c624e49e1bb43188ae9d7dd2b Oct 28 09:56:03.540170 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-21111899 Oct 28 09:56:03.540170 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User: tempest-AttachVolumeNegativeTest-21111899-project Oct 28 09:56:03.540170 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User-Domain-Id: default Oct 28 09:56:03.540170 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User-Domain-Name: Default Oct 28 09:56:03.540170 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User-Id: d38ce75423b5412d90c1158396978b97 Oct 28 09:56:03.540170 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User-Name: tempest-AttachVolumeNegativeTest-21111899-project Oct 28 09:56:03.540170 dv-cinder-zed-3-smb devstack@n-api.service[127033]: method: > Oct 28 09:56:03.540170 dv-cinder-zed-3-smb devstack@n-api.service[127033]: exception: Instance 91ca6322-9cdc-4106-8021-811be2c4af7f could not be found. Oct 28 09:56:03.540170 dv-cinder-zed-3-smb devstack@n-api.service[127033]: action_args: {'id': '91ca6322-9cdc-4106-8021-811be2c4af7f'} Oct 28 09:56:03.541114 dv-cinder-zed-3-smb devstack@n-api.service[127033]: {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:56:03.541114 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:56:03.541114 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 09:56:03.541114 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 09:56:03.541114 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 09:56:03.541114 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 09:56:03.541114 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 09:56:03.541114 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 09:56:03.541114 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 09:56:03.541114 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 09:56:03.541114 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91ca6322-9cdc-4106-8021-811be2c4af7f could not be found. Oct 28 09:56:03.541114 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:56:03.541114 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:56:03.541114 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:56:03.541114 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:56:03.541114 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:56:03.541114 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:56:03.541114 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:56:03.541114 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:56:03.541114 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:56:03.542684 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:56:03.542684 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 09:56:03.542684 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 09:56:03.542684 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 09:56:03.542684 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 09:56:03.542684 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 09:56:03.542684 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 09:56:03.542684 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91ca6322-9cdc-4106-8021-811be2c4af7f could not be found. Oct 28 09:56:03.542684 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:56:03.542684 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:56:03.542684 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:56:03.542684 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:56:03.542684 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:56:03.542684 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:56:03.542684 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:56:03.542684 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:56:03.542684 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91ca6322-9cdc-4106-8021-811be2c4af7f could not be found. Oct 28 09:56:03.542684 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:56:03.544128 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-247a4e1b-cb75-46f2-99c1-aeefc56fab55 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Returning 404 to user: Instance 91ca6322-9cdc-4106-8021-811be2c4af7f could not be found. {{(pid=127033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:56:03.544128 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-247a4e1b-cb75-46f2-99c1-aeefc56fab55 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] 10.222.0.52 "GET /compute/v2.1/servers/91ca6322-9cdc-4106-8021-811be2c4af7f" status: 404 len: 111 microversion: 2.1 time: 0.031338 Oct 28 09:56:03.544128 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 422/858] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:03 2022] GET /compute/v2.1/servers/91ca6322-9cdc-4106-8021-811be2c4af7f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:56:03.549157 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-1afaf453-aa18-4570-ae8b-b02cc4dd7ecd tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Calling method '.version_select at 0x7ff01015adc0>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:03.569264 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-1afaf453-aa18-4570-ae8b-b02cc4dd7ecd tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-619236742" status: 202 len: 0 microversion: 2.1 time: 0.023835 Oct 28 09:56:03.569830 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 437/859] 10.222.0.52 () {58 vars in 1218 bytes} [Fri Oct 28 09:56:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-619236742 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 09:56:03.932090 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-b6620394-1bde-4824-b274-ac5c8c3cf672 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:03.932836 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-b6620394-1bde-4824-b274-ac5c8c3cf672 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] [instance: ad989c34-1973-42cb-82ea-637973bf8d4f] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:03.939649 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-b6620394-1bde-4824-b274-ac5c8c3cf672 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:03.940308 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-b6620394-1bde-4824-b274-ac5c8c3cf672 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:03.940832 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-b6620394-1bde-4824-b274-ac5c8c3cf672 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:03.941610 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-b6620394-1bde-4824-b274-ac5c8c3cf672 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:03.942071 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-b6620394-1bde-4824-b274-ac5c8c3cf672 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:03.942493 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-b6620394-1bde-4824-b274-ac5c8c3cf672 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:04.079698 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-b6620394-1bde-4824-b274-ac5c8c3cf672 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2771d02bec4465d94e98134015b9705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1659fef961ae4ccda1adf6b62c018c9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:04.087351 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-b6620394-1bde-4824-b274-ac5c8c3cf672 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] 10.222.0.52 "GET /compute/v2.1/servers/ad989c34-1973-42cb-82ea-637973bf8d4f" status: 200 len: 1359 microversion: 2.1 time: 0.159177 Oct 28 09:56:04.088138 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 423/860] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:03 2022] GET /compute/v2.1/servers/ad989c34-1973-42cb-82ea-637973bf8d4f => generated 1359 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:04.484943 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-cc1b6622-3ed8-400d-8d99-021855ec02ea tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:04.485500 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-cc1b6622-3ed8-400d-8d99-021855ec02ea tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] [instance: 239cbe4b-b0d1-4361-80af-f3015cb39176] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:04.492027 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-cc1b6622-3ed8-400d-8d99-021855ec02ea tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:04.492512 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-cc1b6622-3ed8-400d-8d99-021855ec02ea tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:04.492948 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-cc1b6622-3ed8-400d-8d99-021855ec02ea tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:04.493642 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-cc1b6622-3ed8-400d-8d99-021855ec02ea tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:04.494098 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-cc1b6622-3ed8-400d-8d99-021855ec02ea tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:04.494524 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-cc1b6622-3ed8-400d-8d99-021855ec02ea tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:04.576761 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.objects.instance [None req-cc1b6622-3ed8-400d-8d99-021855ec02ea tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lazy-loading 'services' on Instance uuid 239cbe4b-b0d1-4361-80af-f3015cb39176 {{(pid=127032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:56:04.650961 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-cc1b6622-3ed8-400d-8d99-021855ec02ea tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] 10.222.0.52 "DELETE /compute/v2.1/servers/239cbe4b-b0d1-4361-80af-f3015cb39176/os-volume_attachments/95ee2c9f-876a-4f48-a969-8347aaa671bb" status: 202 len: 0 microversion: 2.1 time: 0.169759 Oct 28 09:56:04.651812 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 438/861] 10.222.0.52 () {58 vars in 1416 bytes} [Fri Oct 28 09:56:04 2022] DELETE /compute/v2.1/servers/239cbe4b-b0d1-4361-80af-f3015cb39176/os-volume_attachments/95ee2c9f-876a-4f48-a969-8347aaa671bb => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 09:56:04.660406 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-810590e5-6de8-418b-933a-b629531054f1 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:04.662618 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-810590e5-6de8-418b-933a-b629531054f1 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] [instance: 239cbe4b-b0d1-4361-80af-f3015cb39176] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:04.669206 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-810590e5-6de8-418b-933a-b629531054f1 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:04.669699 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-810590e5-6de8-418b-933a-b629531054f1 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:04.670138 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-810590e5-6de8-418b-933a-b629531054f1 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:04.670845 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-810590e5-6de8-418b-933a-b629531054f1 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:04.671301 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-810590e5-6de8-418b-933a-b629531054f1 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:04.671728 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-810590e5-6de8-418b-933a-b629531054f1 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:04.702409 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-810590e5-6de8-418b-933a-b629531054f1 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] 10.222.0.52 "GET /compute/v2.1/servers/239cbe4b-b0d1-4361-80af-f3015cb39176/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045944 Oct 28 09:56:04.702940 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 424/862] 10.222.0.52 () {58 vars in 1302 bytes} [Fri Oct 28 09:56:04 2022] GET /compute/v2.1/servers/239cbe4b-b0d1-4361-80af-f3015cb39176/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:56:05.111179 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-8031c771-d28e-4590-9848-2f54909152cb tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:05.112449 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-8031c771-d28e-4590-9848-2f54909152cb tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] [instance: ad989c34-1973-42cb-82ea-637973bf8d4f] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:05.118840 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-8031c771-d28e-4590-9848-2f54909152cb tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:05.119391 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-8031c771-d28e-4590-9848-2f54909152cb tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:05.120132 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-8031c771-d28e-4590-9848-2f54909152cb tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:05.120834 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-8031c771-d28e-4590-9848-2f54909152cb tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:05.121290 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-8031c771-d28e-4590-9848-2f54909152cb tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:05.121716 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-8031c771-d28e-4590-9848-2f54909152cb tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:05.256768 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-8031c771-d28e-4590-9848-2f54909152cb tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2771d02bec4465d94e98134015b9705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1659fef961ae4ccda1adf6b62c018c9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:05.263833 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [req-f14f584d-3e32-4d2c-bd69-f40b80f364ef req-0f0fb4a3-b615-4477-a729-49939f58a7d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad989c34-1973-42cb-82ea-637973bf8d4f", "name": "network-vif-plugged", "status": "completed", "tag": "543772b3-bb29-406f-b183-de6fa81a0980"}]} {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:56:05.264628 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-8031c771-d28e-4590-9848-2f54909152cb tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] 10.222.0.52 "GET /compute/v2.1/servers/ad989c34-1973-42cb-82ea-637973bf8d4f" status: 200 len: 1359 microversion: 2.1 time: 0.157836 Oct 28 09:56:05.275772 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 439/863] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:05 2022] GET /compute/v2.1/servers/ad989c34-1973-42cb-82ea-637973bf8d4f => generated 1359 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:05.276104 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-f14f584d-3e32-4d2c-bd69-f40b80f364ef req-0f0fb4a3-b615-4477-a729-49939f58a7d3 service nova] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:05.276104 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-f14f584d-3e32-4d2c-bd69-f40b80f364ef req-0f0fb4a3-b615-4477-a729-49939f58a7d3 service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:05.276104 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-f14f584d-3e32-4d2c-bd69-f40b80f364ef req-0f0fb4a3-b615-4477-a729-49939f58a7d3 service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:05.288525 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.compute.server_external_events [req-f14f584d-3e32-4d2c-bd69-f40b80f364ef req-0f0fb4a3-b615-4477-a729-49939f58a7d3 service nova] Creating event network-vif-plugged:543772b3-bb29-406f-b183-de6fa81a0980 for instance ad989c34-1973-42cb-82ea-637973bf8d4f on hv-cinder-zed-3 Oct 28 09:56:05.294034 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [req-f14f584d-3e32-4d2c-bd69-f40b80f364ef req-0f0fb4a3-b615-4477-a729-49939f58a7d3 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033715 Oct 28 09:56:05.295206 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 425/864] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Oct 28 09:56:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 09:56:05.715674 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-2fba6619-129a-4d4b-8912-0cb0b310db59 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:05.717905 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-2fba6619-129a-4d4b-8912-0cb0b310db59 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] [instance: 239cbe4b-b0d1-4361-80af-f3015cb39176] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:05.725029 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-2fba6619-129a-4d4b-8912-0cb0b310db59 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:05.725519 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-2fba6619-129a-4d4b-8912-0cb0b310db59 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:05.725956 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-2fba6619-129a-4d4b-8912-0cb0b310db59 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:05.726647 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-2fba6619-129a-4d4b-8912-0cb0b310db59 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:05.727137 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-2fba6619-129a-4d4b-8912-0cb0b310db59 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:05.727563 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-2fba6619-129a-4d4b-8912-0cb0b310db59 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:05.756714 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-2fba6619-129a-4d4b-8912-0cb0b310db59 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] 10.222.0.52 "GET /compute/v2.1/servers/239cbe4b-b0d1-4361-80af-f3015cb39176/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045104 Oct 28 09:56:05.757265 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 440/865] 10.222.0.52 () {58 vars in 1302 bytes} [Fri Oct 28 09:56:05 2022] GET /compute/v2.1/servers/239cbe4b-b0d1-4361-80af-f3015cb39176/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 09:56:05.822947 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-fe968061-4379-4d6c-8974-55c39f965eee tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:05.823531 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-fe968061-4379-4d6c-8974-55c39f965eee tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] [instance: 239cbe4b-b0d1-4361-80af-f3015cb39176] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:05.830201 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-fe968061-4379-4d6c-8974-55c39f965eee tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:05.831198 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-fe968061-4379-4d6c-8974-55c39f965eee tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:05.831631 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-fe968061-4379-4d6c-8974-55c39f965eee tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:05.832340 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-fe968061-4379-4d6c-8974-55c39f965eee tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:05.832794 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-fe968061-4379-4d6c-8974-55c39f965eee tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:05.833214 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-fe968061-4379-4d6c-8974-55c39f965eee tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:05.858230 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-fe968061-4379-4d6c-8974-55c39f965eee tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] [instance: 239cbe4b-b0d1-4361-80af-f3015cb39176] Going to try to terminate instance {{(pid=127033) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 09:56:05.933393 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-fe968061-4379-4d6c-8974-55c39f965eee tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] 10.222.0.52 "DELETE /compute/v2.1/servers/239cbe4b-b0d1-4361-80af-f3015cb39176" status: 204 len: 0 microversion: 2.1 time: 0.114196 Oct 28 09:56:05.934254 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 426/866] 10.222.0.52 () {58 vars in 1239 bytes} [Fri Oct 28 09:56:05 2022] DELETE /compute/v2.1/servers/239cbe4b-b0d1-4361-80af-f3015cb39176 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 09:56:05.943017 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-ddcbcc5f-4344-49d3-a98c-d9c40d910d81 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:05.943627 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-ddcbcc5f-4344-49d3-a98c-d9c40d910d81 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] [instance: 239cbe4b-b0d1-4361-80af-f3015cb39176] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:05.949565 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ddcbcc5f-4344-49d3-a98c-d9c40d910d81 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:05.950052 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ddcbcc5f-4344-49d3-a98c-d9c40d910d81 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:05.950491 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ddcbcc5f-4344-49d3-a98c-d9c40d910d81 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:05.951183 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ddcbcc5f-4344-49d3-a98c-d9c40d910d81 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:05.951641 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ddcbcc5f-4344-49d3-a98c-d9c40d910d81 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:05.952129 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ddcbcc5f-4344-49d3-a98c-d9c40d910d81 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:06.079419 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-ddcbcc5f-4344-49d3-a98c-d9c40d910d81 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38ce75423b5412d90c1158396978b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e60d7c624e49e1bb43188ae9d7dd2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:06.089033 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-ddcbcc5f-4344-49d3-a98c-d9c40d910d81 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] 10.222.0.52 "GET /compute/v2.1/servers/239cbe4b-b0d1-4361-80af-f3015cb39176" status: 200 len: 1682 microversion: 2.1 time: 0.149849 Oct 28 09:56:06.089618 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 441/867] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:05 2022] GET /compute/v2.1/servers/239cbe4b-b0d1-4361-80af-f3015cb39176 => generated 1682 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:56:06.289010 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-14b3831d-6ef8-4344-bb1f-b0b9e395ac19 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:06.289619 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-14b3831d-6ef8-4344-bb1f-b0b9e395ac19 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] [instance: ad989c34-1973-42cb-82ea-637973bf8d4f] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:06.295392 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-14b3831d-6ef8-4344-bb1f-b0b9e395ac19 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:06.295909 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-14b3831d-6ef8-4344-bb1f-b0b9e395ac19 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:06.296335 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-14b3831d-6ef8-4344-bb1f-b0b9e395ac19 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:06.297012 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-14b3831d-6ef8-4344-bb1f-b0b9e395ac19 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:06.297461 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-14b3831d-6ef8-4344-bb1f-b0b9e395ac19 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:06.297871 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-14b3831d-6ef8-4344-bb1f-b0b9e395ac19 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:06.429967 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-14b3831d-6ef8-4344-bb1f-b0b9e395ac19 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2771d02bec4465d94e98134015b9705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1659fef961ae4ccda1adf6b62c018c9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:06.437624 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-14b3831d-6ef8-4344-bb1f-b0b9e395ac19 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] 10.222.0.52 "GET /compute/v2.1/servers/ad989c34-1973-42cb-82ea-637973bf8d4f" status: 200 len: 1359 microversion: 2.1 time: 0.152909 Oct 28 09:56:06.438187 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 427/868] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:06 2022] GET /compute/v2.1/servers/ad989c34-1973-42cb-82ea-637973bf8d4f => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:07.113044 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-787dccfd-de24-4e04-84b1-db86f1636584 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:07.113599 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-787dccfd-de24-4e04-84b1-db86f1636584 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] [instance: 239cbe4b-b0d1-4361-80af-f3015cb39176] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:07.120312 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-787dccfd-de24-4e04-84b1-db86f1636584 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:07.120823 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-787dccfd-de24-4e04-84b1-db86f1636584 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:07.121263 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-787dccfd-de24-4e04-84b1-db86f1636584 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:07.121957 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-787dccfd-de24-4e04-84b1-db86f1636584 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:07.122413 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-787dccfd-de24-4e04-84b1-db86f1636584 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:07.122844 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-787dccfd-de24-4e04-84b1-db86f1636584 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:07.251698 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-787dccfd-de24-4e04-84b1-db86f1636584 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38ce75423b5412d90c1158396978b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e60d7c624e49e1bb43188ae9d7dd2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:07.259937 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-787dccfd-de24-4e04-84b1-db86f1636584 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] 10.222.0.52 "GET /compute/v2.1/servers/239cbe4b-b0d1-4361-80af-f3015cb39176" status: 200 len: 1682 microversion: 2.1 time: 0.151339 Oct 28 09:56:07.260491 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 442/869] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:07 2022] GET /compute/v2.1/servers/239cbe4b-b0d1-4361-80af-f3015cb39176 => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:07.460642 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-4b3a16ab-8c97-45a7-91b7-6ccbb4a36cb9 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:07.461287 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-4b3a16ab-8c97-45a7-91b7-6ccbb4a36cb9 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] [instance: ad989c34-1973-42cb-82ea-637973bf8d4f] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:07.467706 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-4b3a16ab-8c97-45a7-91b7-6ccbb4a36cb9 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:07.468221 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-4b3a16ab-8c97-45a7-91b7-6ccbb4a36cb9 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:07.468671 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-4b3a16ab-8c97-45a7-91b7-6ccbb4a36cb9 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:07.469355 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-4b3a16ab-8c97-45a7-91b7-6ccbb4a36cb9 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:07.469808 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-4b3a16ab-8c97-45a7-91b7-6ccbb4a36cb9 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:07.470230 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-4b3a16ab-8c97-45a7-91b7-6ccbb4a36cb9 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:07.600685 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-4b3a16ab-8c97-45a7-91b7-6ccbb4a36cb9 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2771d02bec4465d94e98134015b9705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1659fef961ae4ccda1adf6b62c018c9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:07.608189 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-4b3a16ab-8c97-45a7-91b7-6ccbb4a36cb9 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] 10.222.0.52 "GET /compute/v2.1/servers/ad989c34-1973-42cb-82ea-637973bf8d4f" status: 200 len: 1359 microversion: 2.1 time: 0.151387 Oct 28 09:56:07.608745 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 428/870] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:07 2022] GET /compute/v2.1/servers/ad989c34-1973-42cb-82ea-637973bf8d4f => generated 1359 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:08.283044 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-e86dca9c-3eaa-4e18-9a74-04ca8dcb1001 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:08.283657 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-e86dca9c-3eaa-4e18-9a74-04ca8dcb1001 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] [instance: 239cbe4b-b0d1-4361-80af-f3015cb39176] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:08.290062 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-e86dca9c-3eaa-4e18-9a74-04ca8dcb1001 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:08.290546 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-e86dca9c-3eaa-4e18-9a74-04ca8dcb1001 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:08.290977 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-e86dca9c-3eaa-4e18-9a74-04ca8dcb1001 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:08.291680 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-e86dca9c-3eaa-4e18-9a74-04ca8dcb1001 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:08.292146 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-e86dca9c-3eaa-4e18-9a74-04ca8dcb1001 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:08.292566 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-e86dca9c-3eaa-4e18-9a74-04ca8dcb1001 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:08.419952 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-e86dca9c-3eaa-4e18-9a74-04ca8dcb1001 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38ce75423b5412d90c1158396978b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e60d7c624e49e1bb43188ae9d7dd2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:08.427633 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-e86dca9c-3eaa-4e18-9a74-04ca8dcb1001 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] 10.222.0.52 "GET /compute/v2.1/servers/239cbe4b-b0d1-4361-80af-f3015cb39176" status: 200 len: 1682 microversion: 2.1 time: 0.148545 Oct 28 09:56:08.428221 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 443/871] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:08 2022] GET /compute/v2.1/servers/239cbe4b-b0d1-4361-80af-f3015cb39176 => generated 1682 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:08.631652 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-f677d1b0-2e47-406d-b068-831592a448ea tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:08.632349 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-f677d1b0-2e47-406d-b068-831592a448ea tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] [instance: ad989c34-1973-42cb-82ea-637973bf8d4f] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:08.638866 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-f677d1b0-2e47-406d-b068-831592a448ea tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:08.639345 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-f677d1b0-2e47-406d-b068-831592a448ea tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:08.639818 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-f677d1b0-2e47-406d-b068-831592a448ea tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:08.640520 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-f677d1b0-2e47-406d-b068-831592a448ea tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:08.640969 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-f677d1b0-2e47-406d-b068-831592a448ea tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:08.641385 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-f677d1b0-2e47-406d-b068-831592a448ea tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:08.774246 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-f677d1b0-2e47-406d-b068-831592a448ea tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2771d02bec4465d94e98134015b9705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1659fef961ae4ccda1adf6b62c018c9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:08.782032 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-f677d1b0-2e47-406d-b068-831592a448ea tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] 10.222.0.52 "GET /compute/v2.1/servers/ad989c34-1973-42cb-82ea-637973bf8d4f" status: 200 len: 1549 microversion: 2.1 time: 0.154697 Oct 28 09:56:08.782607 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 429/872] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:08 2022] GET /compute/v2.1/servers/ad989c34-1973-42cb-82ea-637973bf8d4f => generated 1549 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:08.805145 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-5c1a3f7a-8df8-477b-89cf-bdbc020a7998 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:08.805883 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-5c1a3f7a-8df8-477b-89cf-bdbc020a7998 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] [instance: ad989c34-1973-42cb-82ea-637973bf8d4f] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:08.811989 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-5c1a3f7a-8df8-477b-89cf-bdbc020a7998 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:08.812484 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-5c1a3f7a-8df8-477b-89cf-bdbc020a7998 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:08.812922 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-5c1a3f7a-8df8-477b-89cf-bdbc020a7998 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:08.813755 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-5c1a3f7a-8df8-477b-89cf-bdbc020a7998 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:08.814218 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-5c1a3f7a-8df8-477b-89cf-bdbc020a7998 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:08.814646 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-5c1a3f7a-8df8-477b-89cf-bdbc020a7998 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:08.946971 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-5c1a3f7a-8df8-477b-89cf-bdbc020a7998 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2771d02bec4465d94e98134015b9705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1659fef961ae4ccda1adf6b62c018c9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:08.954932 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-5c1a3f7a-8df8-477b-89cf-bdbc020a7998 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] 10.222.0.52 "GET /compute/v2.1/servers/ad989c34-1973-42cb-82ea-637973bf8d4f" status: 200 len: 1549 microversion: 2.1 time: 0.153673 Oct 28 09:56:08.955510 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 444/873] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:08 2022] GET /compute/v2.1/servers/ad989c34-1973-42cb-82ea-637973bf8d4f => generated 1549 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:08.977364 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-4ddc706c-2fe4-4f4d-ba45-699bbeb89aa2 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:08.982209 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-4ddc706c-2fe4-4f4d-ba45-699bbeb89aa2 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c2771d02bec4465d94e98134015b9705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1659fef961ae4ccda1adf6b62c018c9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:08.983072 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-4ddc706c-2fe4-4f4d-ba45-699bbeb89aa2 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Searching by: {'deleted': False, 'project_id': '1659fef961ae4ccda1adf6b62c018c9e'} {{(pid=127033) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 09:56:08.990572 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-4ddc706c-2fe4-4f4d-ba45-699bbeb89aa2 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:08.991190 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-4ddc706c-2fe4-4f4d-ba45-699bbeb89aa2 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:08.991898 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-4ddc706c-2fe4-4f4d-ba45-699bbeb89aa2 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:08.992616 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-4ddc706c-2fe4-4f4d-ba45-699bbeb89aa2 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:08.993069 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-4ddc706c-2fe4-4f4d-ba45-699bbeb89aa2 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:08.993503 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-4ddc706c-2fe4-4f4d-ba45-699bbeb89aa2 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:09.083801 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.multi_cell_list [None req-4ddc706c-2fe4-4f4d-ba45-699bbeb89aa2 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127033) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 09:56:09.181831 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-4ddc706c-2fe4-4f4d-ba45-699bbeb89aa2 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] 10.222.0.52 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.208199 Oct 28 09:56:09.182415 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 430/874] 10.222.0.52 () {58 vars in 1125 bytes} [Fri Oct 28 09:56:08 2022] GET /compute/v2.1/servers => generated 343 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:56:09.193974 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-6bd53e50-9e17-4000-a90c-712e599c6ea7 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:09.194586 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-6bd53e50-9e17-4000-a90c-712e599c6ea7 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] [instance: ad989c34-1973-42cb-82ea-637973bf8d4f] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:09.200464 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-6bd53e50-9e17-4000-a90c-712e599c6ea7 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:09.200954 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-6bd53e50-9e17-4000-a90c-712e599c6ea7 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:09.201386 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-6bd53e50-9e17-4000-a90c-712e599c6ea7 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:09.202113 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-6bd53e50-9e17-4000-a90c-712e599c6ea7 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:09.202562 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-6bd53e50-9e17-4000-a90c-712e599c6ea7 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:09.203205 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-6bd53e50-9e17-4000-a90c-712e599c6ea7 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:09.332434 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-6bd53e50-9e17-4000-a90c-712e599c6ea7 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2771d02bec4465d94e98134015b9705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1659fef961ae4ccda1adf6b62c018c9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:09.340529 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-6bd53e50-9e17-4000-a90c-712e599c6ea7 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] 10.222.0.52 "GET /compute/v2.1/servers/ad989c34-1973-42cb-82ea-637973bf8d4f" status: 200 len: 1549 microversion: 2.1 time: 0.150367 Oct 28 09:56:09.341327 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 445/875] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:09 2022] GET /compute/v2.1/servers/ad989c34-1973-42cb-82ea-637973bf8d4f => generated 1549 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:09.452454 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-482880dc-83b5-49c3-bcc1-6dfc4719a7a6 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:09.453404 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [req-bf5cc121-0358-458b-8baa-8649bcdc1f18 req-cf6dd4fc-13e0-4777-89df-1b757ebae565 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "239cbe4b-b0d1-4361-80af-f3015cb39176", "name": "network-vif-deleted", "tag": "b789fb10-4c3e-4628-b3fd-048e4ddace53"}]} {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:56:09.453689 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-482880dc-83b5-49c3-bcc1-6dfc4719a7a6 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] [instance: 239cbe4b-b0d1-4361-80af-f3015cb39176] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:09.464684 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-482880dc-83b5-49c3-bcc1-6dfc4719a7a6 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:09.465393 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-bf5cc121-0358-458b-8baa-8649bcdc1f18 req-cf6dd4fc-13e0-4777-89df-1b757ebae565 service nova] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:09.466077 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-bf5cc121-0358-458b-8baa-8649bcdc1f18 req-cf6dd4fc-13e0-4777-89df-1b757ebae565 service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:09.466684 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-bf5cc121-0358-458b-8baa-8649bcdc1f18 req-cf6dd4fc-13e0-4777-89df-1b757ebae565 service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:09.467067 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-482880dc-83b5-49c3-bcc1-6dfc4719a7a6 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:09.469801 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-482880dc-83b5-49c3-bcc1-6dfc4719a7a6 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:09.472300 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-482880dc-83b5-49c3-bcc1-6dfc4719a7a6 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:09.473354 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-482880dc-83b5-49c3-bcc1-6dfc4719a7a6 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:09.476814 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-482880dc-83b5-49c3-bcc1-6dfc4719a7a6 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:09.490908 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.compute.server_external_events [req-bf5cc121-0358-458b-8baa-8649bcdc1f18 req-cf6dd4fc-13e0-4777-89df-1b757ebae565 service nova] Creating event network-vif-deleted:b789fb10-4c3e-4628-b3fd-048e4ddace53 for instance 239cbe4b-b0d1-4361-80af-f3015cb39176 on hv-cinder-zed-3 Oct 28 09:56:09.499592 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [req-bf5cc121-0358-458b-8baa-8649bcdc1f18 req-cf6dd4fc-13e0-4777-89df-1b757ebae565 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130811 Oct 28 09:56:09.500618 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 431/876] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Oct 28 09:56:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:56:09.531528 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-482880dc-83b5-49c3-bcc1-6dfc4719a7a6 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:09.532395 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-482880dc-83b5-49c3-bcc1-6dfc4719a7a6 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:09.533067 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-482880dc-83b5-49c3-bcc1-6dfc4719a7a6 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:09.533804 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.objects.instance [None req-482880dc-83b5-49c3-bcc1-6dfc4719a7a6 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lazy-loading 'fault' on Instance uuid 239cbe4b-b0d1-4361-80af-f3015cb39176 {{(pid=127032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:56:09.609425 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-482880dc-83b5-49c3-bcc1-6dfc4719a7a6 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38ce75423b5412d90c1158396978b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e60d7c624e49e1bb43188ae9d7dd2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:09.622922 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-482880dc-83b5-49c3-bcc1-6dfc4719a7a6 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] 10.222.0.52 "GET /compute/v2.1/servers/239cbe4b-b0d1-4361-80af-f3015cb39176" status: 200 len: 1331 microversion: 2.1 time: 0.174717 Oct 28 09:56:09.641570 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 446/877] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:09 2022] GET /compute/v2.1/servers/239cbe4b-b0d1-4361-80af-f3015cb39176 => generated 1331 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:56:10.649599 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-19e7afd6-ecdf-4c16-9263-24c55fe09a64 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:10.650314 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-19e7afd6-ecdf-4c16-9263-24c55fe09a64 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] [instance: 239cbe4b-b0d1-4361-80af-f3015cb39176] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:10.656824 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-19e7afd6-ecdf-4c16-9263-24c55fe09a64 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:10.657448 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-19e7afd6-ecdf-4c16-9263-24c55fe09a64 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:10.657901 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-19e7afd6-ecdf-4c16-9263-24c55fe09a64 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:10.658589 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-19e7afd6-ecdf-4c16-9263-24c55fe09a64 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:10.659043 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-19e7afd6-ecdf-4c16-9263-24c55fe09a64 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:10.659464 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-19e7afd6-ecdf-4c16-9263-24c55fe09a64 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:10.672513 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.wsgi [None req-19e7afd6-ecdf-4c16-9263-24c55fe09a64 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] HTTP exception thrown: Instance 239cbe4b-b0d1-4361-80af-f3015cb39176 could not be found. Oct 28 09:56:10.674031 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-19e7afd6-ecdf-4c16-9263-24c55fe09a64 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Request method failure captured: Oct 28 09:56:10.674031 dv-cinder-zed-3-smb devstack@n-api.service[127033]: request: GET /compute/v2.1/servers/239cbe4b-b0d1-4361-80af-f3015cb39176 HTTP/1.1 Oct 28 09:56:10.674031 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Accept: application/json Oct 28 09:56:10.674031 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Accept-Encoding: identity Oct 28 09:56:10.674031 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Connection: close Oct 28 09:56:10.674031 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Content-Length: 0 Oct 28 09:56:10.674031 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Content-Type: application/json Oct 28 09:56:10.674031 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Host: 10.222.0.52 Oct 28 09:56:10.674031 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Openstack-System-Scope: None Oct 28 09:56:10.674031 dv-cinder-zed-3-smb devstack@n-api.service[127033]: User-Agent: python-urllib3/1.26.12 Oct 28 09:56:10.674031 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Auth-Token: gAAAAABjW6ZlB_y8UlHttqFpTZf-FQqNFL8UpqBADpRqoMnMvW_jAoL6f5CF8d3TJuqshSrx4zOxOgPBQaaPIBzA2l5d4VliO6WO9dxAWAz2QeafoRTcYtg1CKFv-cJOUbVbMelTlyaihpwFtFOGoW8EkNwvlaaR3DGtxA3ButWLQbGRra0UmvI Oct 28 09:56:10.674031 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Domain-Id: None Oct 28 09:56:10.674031 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Domain-Name: None Oct 28 09:56:10.674031 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Identity-Status: Confirmed Oct 28 09:56:10.674031 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Is-Admin-Project: True Oct 28 09:56:10.674031 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Project-Domain-Id: default Oct 28 09:56:10.674031 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Project-Domain-Name: Default Oct 28 09:56:10.674031 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Project-Id: 68e60d7c624e49e1bb43188ae9d7dd2b Oct 28 09:56:10.674031 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Project-Name: tempest-AttachVolumeNegativeTest-21111899 Oct 28 09:56:10.674031 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Role: reader,member Oct 28 09:56:10.674031 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Roles: reader,member Oct 28 09:56:10.675424 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_68e60d7c624e49e1bb43188ae9d7dd2b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/68e60d7c624e49e1bb43188ae9d7dd2b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/68e60d7c624e49e1bb43188ae9d7dd2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/68e60d7c624e49e1bb43188ae9d7dd2b"}]}] Oct 28 09:56:10.675424 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Tenant: tempest-AttachVolumeNegativeTest-21111899 Oct 28 09:56:10.675424 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Tenant-Id: 68e60d7c624e49e1bb43188ae9d7dd2b Oct 28 09:56:10.675424 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-21111899 Oct 28 09:56:10.675424 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User: tempest-AttachVolumeNegativeTest-21111899-project Oct 28 09:56:10.675424 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User-Domain-Id: default Oct 28 09:56:10.675424 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User-Domain-Name: Default Oct 28 09:56:10.675424 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User-Id: d38ce75423b5412d90c1158396978b97 Oct 28 09:56:10.675424 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User-Name: tempest-AttachVolumeNegativeTest-21111899-project Oct 28 09:56:10.675424 dv-cinder-zed-3-smb devstack@n-api.service[127033]: method: > Oct 28 09:56:10.675424 dv-cinder-zed-3-smb devstack@n-api.service[127033]: exception: Instance 239cbe4b-b0d1-4361-80af-f3015cb39176 could not be found. Oct 28 09:56:10.675424 dv-cinder-zed-3-smb devstack@n-api.service[127033]: action_args: {'id': '239cbe4b-b0d1-4361-80af-f3015cb39176'} Oct 28 09:56:10.676243 dv-cinder-zed-3-smb devstack@n-api.service[127033]: {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:56:10.676243 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:56:10.676243 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 09:56:10.676243 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 09:56:10.676243 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 09:56:10.676243 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 09:56:10.676243 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 09:56:10.676243 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 09:56:10.676243 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 09:56:10.676243 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 09:56:10.676243 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 239cbe4b-b0d1-4361-80af-f3015cb39176 could not be found. Oct 28 09:56:10.676243 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:56:10.676243 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:56:10.676243 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:56:10.676243 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:56:10.676243 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:56:10.676243 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:56:10.676243 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:56:10.676243 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:56:10.676243 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:56:10.677755 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:56:10.677755 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 09:56:10.677755 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 09:56:10.677755 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 09:56:10.677755 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 09:56:10.677755 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 09:56:10.677755 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 09:56:10.677755 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 239cbe4b-b0d1-4361-80af-f3015cb39176 could not be found. Oct 28 09:56:10.677755 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:56:10.677755 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:56:10.677755 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:56:10.677755 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:56:10.677755 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:56:10.677755 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:56:10.677755 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:56:10.677755 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:56:10.677755 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 239cbe4b-b0d1-4361-80af-f3015cb39176 could not be found. Oct 28 09:56:10.677755 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:56:10.679166 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-19e7afd6-ecdf-4c16-9263-24c55fe09a64 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Returning 404 to user: Instance 239cbe4b-b0d1-4361-80af-f3015cb39176 could not be found. {{(pid=127033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:56:10.679166 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-19e7afd6-ecdf-4c16-9263-24c55fe09a64 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] 10.222.0.52 "GET /compute/v2.1/servers/239cbe4b-b0d1-4361-80af-f3015cb39176" status: 404 len: 111 microversion: 2.1 time: 0.030077 Oct 28 09:56:10.679166 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 432/878] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:10 2022] GET /compute/v2.1/servers/239cbe4b-b0d1-4361-80af-f3015cb39176 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:56:10.684258 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-aca58761-8f1e-49b9-bac3-b77703c34c50 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Calling method '.version_select at 0x7ff0102b8a60>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:10.703085 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-aca58761-8f1e-49b9-bac3-b77703c34c50 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1082349739" status: 202 len: 0 microversion: 2.1 time: 0.022565 Oct 28 09:56:10.703656 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 447/879] 10.222.0.52 () {58 vars in 1221 bytes} [Fri Oct 28 09:56:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1082349739 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 09:56:11.047402 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-1afb431e-275f-4c5c-87d4-906817780fc8 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9d5d91cc-8deb-4ee2-934e-ed0c68f70722"}} {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:56:11.050359 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-1afb431e-275f-4c5c-87d4-906817780fc8 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] [instance: ad989c34-1973-42cb-82ea-637973bf8d4f] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:11.056562 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-1afb431e-275f-4c5c-87d4-906817780fc8 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:11.057042 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-1afb431e-275f-4c5c-87d4-906817780fc8 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:11.057470 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-1afb431e-275f-4c5c-87d4-906817780fc8 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:11.058157 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-1afb431e-275f-4c5c-87d4-906817780fc8 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:11.058605 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-1afb431e-275f-4c5c-87d4-906817780fc8 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:11.059026 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-1afb431e-275f-4c5c-87d4-906817780fc8 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:11.354985 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-cf4dabbd-2d9f-4c90-97b4-70d38fa52857 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Action: 'create', calling method: .version_select at 0x7ff013b59670>, body: {"keypair": {"name": "tempest-keypair-2026557179", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGaeyKI31eTkNdSp+AWNgF/2DoJbiLw5Vd/t2MN2QJQui3qx1Uqtbdyyn/glwoy7Mf9u0saU8IAK6H1Zdrws3OVuYsQeGKym/4gnuDxPMwmok04Bc/IksNhfgDWIlyKU3g=="}} {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:56:11.372937 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.quota [None req-cf4dabbd-2d9f-4c90-97b4-70d38fa52857 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Getting quotas for project 68e60d7c624e49e1bb43188ae9d7dd2b. Resources: {'key_pairs'} {{(pid=127032) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 09:56:11.377133 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.quota [None req-cf4dabbd-2d9f-4c90-97b4-70d38fa52857 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Getting quotas for user d38ce75423b5412d90c1158396978b97 and project 68e60d7c624e49e1bb43188ae9d7dd2b. Resources: {'key_pairs'} {{(pid=127032) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 09:56:11.402081 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-cf4dabbd-2d9f-4c90-97b4-70d38fa52857 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.051231 Oct 28 09:56:11.402694 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 448/880] 10.222.0.52 () {60 vars in 1159 bytes} [Fri Oct 28 09:56:11 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 09:56:11.481456 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-1afb431e-275f-4c5c-87d4-906817780fc8 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] 10.222.0.52 "POST /compute/v2.1/servers/ad989c34-1973-42cb-82ea-637973bf8d4f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.437562 Oct 28 09:56:11.483784 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 433/881] 10.222.0.52 () {60 vars in 1323 bytes} [Fri Oct 28 09:56:11 2022] POST /compute/v2.1/servers/ad989c34-1973-42cb-82ea-637973bf8d4f/os-volume_attachments => generated 194 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:56:12.728017 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-72487a2f-9e87-4846-bdbc-f352b3fd6e61 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1323503064", "imageRef": "6e314146-a2ed-4f8b-afdd-4f7ed1184d20", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a8c5bacf-14eb-40aa-b7c5-10fa69559527"}], "security_groups": [{"name": "tempest-securitygroup--1888692508"}], "key_name": "tempest-keypair-2026557179", "user_data": "}} {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:56:12.835154 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.network.neutron [None req-72487a2f-9e87-4846-bdbc-f352b3fd6e61 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] validate_networks() for [('a8c5bacf-14eb-40aa-b7c5-10fa69559527', None, None, None, None, None)] {{(pid=127032) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 09:56:13.214430 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.virt.hardware [None req-72487a2f-9e87-4846-bdbc-f352b3fd6e61 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Flavor limits 0:0:0 {{(pid=127032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 09:56:13.214848 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.virt.hardware [None req-72487a2f-9e87-4846-bdbc-f352b3fd6e61 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Image limits 0:0:0 {{(pid=127032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 09:56:13.215312 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.virt.hardware [None req-72487a2f-9e87-4846-bdbc-f352b3fd6e61 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Flavor pref 0:0:0 {{(pid=127032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 09:56:13.215710 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.virt.hardware [None req-72487a2f-9e87-4846-bdbc-f352b3fd6e61 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Image pref 0:0:0 {{(pid=127032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 09:56:13.216158 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.virt.hardware [None req-72487a2f-9e87-4846-bdbc-f352b3fd6e61 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 09:56:13.224760 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-72487a2f-9e87-4846-bdbc-f352b3fd6e61 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:13.225233 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-72487a2f-9e87-4846-bdbc-f352b3fd6e61 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:13.225658 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-72487a2f-9e87-4846-bdbc-f352b3fd6e61 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:13.226371 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-72487a2f-9e87-4846-bdbc-f352b3fd6e61 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:13.226816 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-72487a2f-9e87-4846-bdbc-f352b3fd6e61 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:13.227233 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-72487a2f-9e87-4846-bdbc-f352b3fd6e61 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:13.238634 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG dbcounter [-] [127032] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:DELETE=2 {{(pid=127032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:56:13.245387 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.quota [None req-72487a2f-9e87-4846-bdbc-f352b3fd6e61 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Getting quotas for project 68e60d7c624e49e1bb43188ae9d7dd2b. Resources: {'cores', 'ram', 'instances'} {{(pid=127032) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 09:56:13.250034 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.quota [None req-72487a2f-9e87-4846-bdbc-f352b3fd6e61 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Getting quotas for user d38ce75423b5412d90c1158396978b97 and project 68e60d7c624e49e1bb43188ae9d7dd2b. Resources: {'cores', 'ram', 'instances'} {{(pid=127032) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 09:56:13.261773 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-72487a2f-9e87-4846-bdbc-f352b3fd6e61 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Going to run 1 instances... {{(pid=127032) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 09:56:13.264056 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-72487a2f-9e87-4846-bdbc-f352b3fd6e61 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] [instance: 6be25faa-d7aa-4bd8-9bc5-b1f2615b1fea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e314146-a2ed-4f8b-afdd-4f7ed1184d20',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127032) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 09:56:13.309462 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-72487a2f-9e87-4846-bdbc-f352b3fd6e61 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.586935 Oct 28 09:56:13.310111 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 449/882] 10.222.0.52 () {60 vars in 1147 bytes} [Fri Oct 28 09:56:12 2022] POST /compute/v2.1/servers => generated 402 bytes in 589 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 09:56:13.323310 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-c856a1f3-714c-4584-a9ad-cef57c560f31 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:13.324054 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-c856a1f3-714c-4584-a9ad-cef57c560f31 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] [instance: 6be25faa-d7aa-4bd8-9bc5-b1f2615b1fea] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:13.379288 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-c856a1f3-714c-4584-a9ad-cef57c560f31 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38ce75423b5412d90c1158396978b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e60d7c624e49e1bb43188ae9d7dd2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:13.386911 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-c856a1f3-714c-4584-a9ad-cef57c560f31 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] 10.222.0.52 "GET /compute/v2.1/servers/6be25faa-d7aa-4bd8-9bc5-b1f2615b1fea" status: 200 len: 1242 microversion: 2.1 time: 0.068523 Oct 28 09:56:13.387479 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 434/883] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:13 2022] GET /compute/v2.1/servers/6be25faa-d7aa-4bd8-9bc5-b1f2615b1fea => generated 1242 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:13.826150 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-eed60469-4294-4b9b-8432-e3377ab42b6e tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:13.826766 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-eed60469-4294-4b9b-8432-e3377ab42b6e tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] [instance: ad989c34-1973-42cb-82ea-637973bf8d4f] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:13.833518 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-eed60469-4294-4b9b-8432-e3377ab42b6e tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:13.834002 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-eed60469-4294-4b9b-8432-e3377ab42b6e tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:13.834437 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-eed60469-4294-4b9b-8432-e3377ab42b6e tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:13.835120 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-eed60469-4294-4b9b-8432-e3377ab42b6e tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:13.835575 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-eed60469-4294-4b9b-8432-e3377ab42b6e tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:13.836023 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-eed60469-4294-4b9b-8432-e3377ab42b6e tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:13.976796 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-eed60469-4294-4b9b-8432-e3377ab42b6e tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2771d02bec4465d94e98134015b9705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1659fef961ae4ccda1adf6b62c018c9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:13.985012 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-eed60469-4294-4b9b-8432-e3377ab42b6e tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] 10.222.0.52 "GET /compute/v2.1/servers/ad989c34-1973-42cb-82ea-637973bf8d4f" status: 200 len: 1595 microversion: 2.1 time: 0.163345 Oct 28 09:56:13.986297 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 450/884] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:13 2022] GET /compute/v2.1/servers/ad989c34-1973-42cb-82ea-637973bf8d4f => generated 1595 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:14.410178 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-2653bf3f-a125-45ca-a01d-f06f4ea032f4 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:14.410784 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-2653bf3f-a125-45ca-a01d-f06f4ea032f4 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] [instance: 6be25faa-d7aa-4bd8-9bc5-b1f2615b1fea] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:14.413349 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG dbcounter [-] [127033] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=1,nova_api:UPDATE=2 {{(pid=127033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:56:14.418975 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-2653bf3f-a125-45ca-a01d-f06f4ea032f4 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:14.419697 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-2653bf3f-a125-45ca-a01d-f06f4ea032f4 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:14.420345 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-2653bf3f-a125-45ca-a01d-f06f4ea032f4 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:14.421060 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-2653bf3f-a125-45ca-a01d-f06f4ea032f4 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:14.421517 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-2653bf3f-a125-45ca-a01d-f06f4ea032f4 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:14.421941 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-2653bf3f-a125-45ca-a01d-f06f4ea032f4 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:14.492126 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-2653bf3f-a125-45ca-a01d-f06f4ea032f4 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38ce75423b5412d90c1158396978b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e60d7c624e49e1bb43188ae9d7dd2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:14.507545 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-2653bf3f-a125-45ca-a01d-f06f4ea032f4 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] 10.222.0.52 "GET /compute/v2.1/servers/6be25faa-d7aa-4bd8-9bc5-b1f2615b1fea" status: 200 len: 1294 microversion: 2.1 time: 0.101612 Oct 28 09:56:14.508161 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 435/885] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:14 2022] GET /compute/v2.1/servers/6be25faa-d7aa-4bd8-9bc5-b1f2615b1fea => generated 1294 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:15.531689 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-24e618fe-ddfb-4314-a3d5-8b2e528ab7ec tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:15.533441 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-24e618fe-ddfb-4314-a3d5-8b2e528ab7ec tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] [instance: 6be25faa-d7aa-4bd8-9bc5-b1f2615b1fea] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:15.541371 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-24e618fe-ddfb-4314-a3d5-8b2e528ab7ec tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:15.541970 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-24e618fe-ddfb-4314-a3d5-8b2e528ab7ec tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:15.542509 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-24e618fe-ddfb-4314-a3d5-8b2e528ab7ec tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:15.543997 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-24e618fe-ddfb-4314-a3d5-8b2e528ab7ec tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:15.544579 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-24e618fe-ddfb-4314-a3d5-8b2e528ab7ec tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:15.545102 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-24e618fe-ddfb-4314-a3d5-8b2e528ab7ec tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:15.824545 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-24e618fe-ddfb-4314-a3d5-8b2e528ab7ec tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38ce75423b5412d90c1158396978b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e60d7c624e49e1bb43188ae9d7dd2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:15.834079 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-24e618fe-ddfb-4314-a3d5-8b2e528ab7ec tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] 10.222.0.52 "GET /compute/v2.1/servers/6be25faa-d7aa-4bd8-9bc5-b1f2615b1fea" status: 200 len: 1368 microversion: 2.1 time: 0.306897 Oct 28 09:56:15.834663 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 451/886] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:15 2022] GET /compute/v2.1/servers/6be25faa-d7aa-4bd8-9bc5-b1f2615b1fea => generated 1368 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:15.998214 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [req-2eca2f79-8f74-45f9-9b74-38f7481b99a6 req-c4fe3ba6-50e6-4761-ba13-9ae1c8715430 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad989c34-1973-42cb-82ea-637973bf8d4f", "tag": "543772b3-bb29-406f-b183-de6fa81a0980"}]} {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:56:16.009097 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-2eca2f79-8f74-45f9-9b74-38f7481b99a6 req-c4fe3ba6-50e6-4761-ba13-9ae1c8715430 service nova] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:16.009583 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-2eca2f79-8f74-45f9-9b74-38f7481b99a6 req-c4fe3ba6-50e6-4761-ba13-9ae1c8715430 service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:16.010018 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-2eca2f79-8f74-45f9-9b74-38f7481b99a6 req-c4fe3ba6-50e6-4761-ba13-9ae1c8715430 service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:16.022635 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.compute.server_external_events [req-2eca2f79-8f74-45f9-9b74-38f7481b99a6 req-c4fe3ba6-50e6-4761-ba13-9ae1c8715430 service nova] Creating event network-changed:543772b3-bb29-406f-b183-de6fa81a0980 for instance ad989c34-1973-42cb-82ea-637973bf8d4f on hv-cinder-zed-3 Oct 28 09:56:16.028351 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [req-2eca2f79-8f74-45f9-9b74-38f7481b99a6 req-c4fe3ba6-50e6-4761-ba13-9ae1c8715430 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034022 Oct 28 09:56:16.029037 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 436/887] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Oct 28 09:56:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:56:16.118710 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [req-4d27a754-5355-4887-99b2-eff743f6c4a3 req-9cd76972-7a69-4ac7-ab53-6188f79791e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6be25faa-d7aa-4bd8-9bc5-b1f2615b1fea", "tag": "4ebb832d-2608-4bca-83d7-11d81dded89a"}]} {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:56:16.134154 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-4d27a754-5355-4887-99b2-eff743f6c4a3 req-9cd76972-7a69-4ac7-ab53-6188f79791e8 service nova] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:16.134995 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-4d27a754-5355-4887-99b2-eff743f6c4a3 req-9cd76972-7a69-4ac7-ab53-6188f79791e8 service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:16.136118 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-4d27a754-5355-4887-99b2-eff743f6c4a3 req-9cd76972-7a69-4ac7-ab53-6188f79791e8 service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:16.157832 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.compute.server_external_events [req-4d27a754-5355-4887-99b2-eff743f6c4a3 req-9cd76972-7a69-4ac7-ab53-6188f79791e8 service nova] Creating event network-changed:4ebb832d-2608-4bca-83d7-11d81dded89a for instance 6be25faa-d7aa-4bd8-9bc5-b1f2615b1fea on hv-cinder-zed-3 Oct 28 09:56:16.167274 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [req-4d27a754-5355-4887-99b2-eff743f6c4a3 req-9cd76972-7a69-4ac7-ab53-6188f79791e8 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057447 Oct 28 09:56:16.168191 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 452/888] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Oct 28 09:56:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:56:16.859191 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-91dfad81-99a9-4f98-b4a8-8884d98b0d03 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:16.859959 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-91dfad81-99a9-4f98-b4a8-8884d98b0d03 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] [instance: 6be25faa-d7aa-4bd8-9bc5-b1f2615b1fea] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:16.873784 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-91dfad81-99a9-4f98-b4a8-8884d98b0d03 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:16.874287 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-91dfad81-99a9-4f98-b4a8-8884d98b0d03 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:16.874727 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-91dfad81-99a9-4f98-b4a8-8884d98b0d03 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:16.877389 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-91dfad81-99a9-4f98-b4a8-8884d98b0d03 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:16.879647 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-91dfad81-99a9-4f98-b4a8-8884d98b0d03 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:16.880255 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-91dfad81-99a9-4f98-b4a8-8884d98b0d03 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:17.087305 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-91dfad81-99a9-4f98-b4a8-8884d98b0d03 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38ce75423b5412d90c1158396978b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e60d7c624e49e1bb43188ae9d7dd2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:17.095186 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG dbcounter [-] [127033] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:56:17.099453 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-91dfad81-99a9-4f98-b4a8-8884d98b0d03 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] 10.222.0.52 "GET /compute/v2.1/servers/6be25faa-d7aa-4bd8-9bc5-b1f2615b1fea" status: 200 len: 1368 microversion: 2.1 time: 0.244872 Oct 28 09:56:17.112522 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 437/889] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:16 2022] GET /compute/v2.1/servers/6be25faa-d7aa-4bd8-9bc5-b1f2615b1fea => generated 1368 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:17.518559 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-44c0475b-202b-498b-9464-7c3df81ed539 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1860808420"}} {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:56:17.519169 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-44c0475b-202b-498b-9464-7c3df81ed539 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] [instance: ad989c34-1973-42cb-82ea-637973bf8d4f] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:17.525285 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-44c0475b-202b-498b-9464-7c3df81ed539 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:17.525758 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-44c0475b-202b-498b-9464-7c3df81ed539 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:17.526184 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-44c0475b-202b-498b-9464-7c3df81ed539 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:17.526860 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-44c0475b-202b-498b-9464-7c3df81ed539 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:17.527303 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-44c0475b-202b-498b-9464-7c3df81ed539 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:17.527716 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-44c0475b-202b-498b-9464-7c3df81ed539 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:17.657446 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.network.security_group_api [None req-44c0475b-202b-498b-9464-7c3df81ed539 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Adding security group d376628a-becb-4670-a2fc-753def2bc8e8 to port 543772b3-bb29-406f-b183-de6fa81a0980 Oct 28 09:56:18.024531 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-44c0475b-202b-498b-9464-7c3df81ed539 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] 10.222.0.52 "POST /compute/v2.1/servers/ad989c34-1973-42cb-82ea-637973bf8d4f/action" status: 202 len: 0 microversion: 2.1 time: 0.510640 Oct 28 09:56:18.025149 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 453/890] 10.222.0.52 () {60 vars in 1278 bytes} [Fri Oct 28 09:56:17 2022] POST /compute/v2.1/servers/ad989c34-1973-42cb-82ea-637973bf8d4f/action => generated 0 bytes in 512 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:56:18.035543 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-5449ca6a-871e-427a-b2d8-d3276de802e4 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:18.036186 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-5449ca6a-871e-427a-b2d8-d3276de802e4 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] [instance: ad989c34-1973-42cb-82ea-637973bf8d4f] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:18.044540 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-5449ca6a-871e-427a-b2d8-d3276de802e4 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:18.045033 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-5449ca6a-871e-427a-b2d8-d3276de802e4 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:18.045469 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-5449ca6a-871e-427a-b2d8-d3276de802e4 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:18.046159 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-5449ca6a-871e-427a-b2d8-d3276de802e4 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:18.046612 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-5449ca6a-871e-427a-b2d8-d3276de802e4 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:18.047035 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-5449ca6a-871e-427a-b2d8-d3276de802e4 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:18.060415 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [req-45531d3e-cd77-494c-803f-6ca47d4683f6 req-12467ca4-60c4-4665-a28f-4700f091bf7f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad989c34-1973-42cb-82ea-637973bf8d4f", "tag": "543772b3-bb29-406f-b183-de6fa81a0980"}]} {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:56:18.080934 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-45531d3e-cd77-494c-803f-6ca47d4683f6 req-12467ca4-60c4-4665-a28f-4700f091bf7f service nova] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:18.081755 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-45531d3e-cd77-494c-803f-6ca47d4683f6 req-12467ca4-60c4-4665-a28f-4700f091bf7f service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:18.082420 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-45531d3e-cd77-494c-803f-6ca47d4683f6 req-12467ca4-60c4-4665-a28f-4700f091bf7f service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:18.094864 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.compute.server_external_events [req-45531d3e-cd77-494c-803f-6ca47d4683f6 req-12467ca4-60c4-4665-a28f-4700f091bf7f service nova] Creating event network-changed:543772b3-bb29-406f-b183-de6fa81a0980 for instance ad989c34-1973-42cb-82ea-637973bf8d4f on hv-cinder-zed-3 Oct 28 09:56:18.109816 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [req-45531d3e-cd77-494c-803f-6ca47d4683f6 req-12467ca4-60c4-4665-a28f-4700f091bf7f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052908 Oct 28 09:56:18.110782 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 454/891] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Oct 28 09:56:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 09:56:18.124763 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-1626b60e-45cf-4bc1-a68b-2a903d466937 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:18.125582 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-1626b60e-45cf-4bc1-a68b-2a903d466937 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] [instance: 6be25faa-d7aa-4bd8-9bc5-b1f2615b1fea] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:18.134461 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-1626b60e-45cf-4bc1-a68b-2a903d466937 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:18.135017 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-1626b60e-45cf-4bc1-a68b-2a903d466937 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:18.135526 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-1626b60e-45cf-4bc1-a68b-2a903d466937 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:18.136361 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-1626b60e-45cf-4bc1-a68b-2a903d466937 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:18.136890 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-1626b60e-45cf-4bc1-a68b-2a903d466937 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:18.137386 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-1626b60e-45cf-4bc1-a68b-2a903d466937 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:18.270804 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-5449ca6a-871e-427a-b2d8-d3276de802e4 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2771d02bec4465d94e98134015b9705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1659fef961ae4ccda1adf6b62c018c9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:18.280704 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-5449ca6a-871e-427a-b2d8-d3276de802e4 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] 10.222.0.52 "GET /compute/v2.1/servers/ad989c34-1973-42cb-82ea-637973bf8d4f" status: 200 len: 1642 microversion: 2.1 time: 0.251088 Oct 28 09:56:18.296182 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 438/892] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:18 2022] GET /compute/v2.1/servers/ad989c34-1973-42cb-82ea-637973bf8d4f => generated 1642 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:56:18.310062 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-1626b60e-45cf-4bc1-a68b-2a903d466937 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38ce75423b5412d90c1158396978b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e60d7c624e49e1bb43188ae9d7dd2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:18.317879 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-1626b60e-45cf-4bc1-a68b-2a903d466937 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] 10.222.0.52 "GET /compute/v2.1/servers/6be25faa-d7aa-4bd8-9bc5-b1f2615b1fea" status: 200 len: 1368 microversion: 2.1 time: 0.197871 Oct 28 09:56:18.318654 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 455/893] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:18 2022] GET /compute/v2.1/servers/6be25faa-d7aa-4bd8-9bc5-b1f2615b1fea => generated 1368 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:56:19.341201 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-094ea91b-7a8e-43a5-963b-aa1a7ffde1c2 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:19.341810 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-094ea91b-7a8e-43a5-963b-aa1a7ffde1c2 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] [instance: 6be25faa-d7aa-4bd8-9bc5-b1f2615b1fea] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:19.343656 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG dbcounter [-] [127033] Writing DB stats nova_cell0:SELECT=2 {{(pid=127033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:56:19.350163 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-094ea91b-7a8e-43a5-963b-aa1a7ffde1c2 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:19.350655 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-094ea91b-7a8e-43a5-963b-aa1a7ffde1c2 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:19.351096 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-094ea91b-7a8e-43a5-963b-aa1a7ffde1c2 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:19.351895 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-094ea91b-7a8e-43a5-963b-aa1a7ffde1c2 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:19.352480 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-094ea91b-7a8e-43a5-963b-aa1a7ffde1c2 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:19.352914 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-094ea91b-7a8e-43a5-963b-aa1a7ffde1c2 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:19.487045 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-094ea91b-7a8e-43a5-963b-aa1a7ffde1c2 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38ce75423b5412d90c1158396978b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e60d7c624e49e1bb43188ae9d7dd2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:19.495116 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-094ea91b-7a8e-43a5-963b-aa1a7ffde1c2 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] 10.222.0.52 "GET /compute/v2.1/servers/6be25faa-d7aa-4bd8-9bc5-b1f2615b1fea" status: 200 len: 1368 microversion: 2.1 time: 0.158236 Oct 28 09:56:19.496555 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 439/894] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:19 2022] GET /compute/v2.1/servers/6be25faa-d7aa-4bd8-9bc5-b1f2615b1fea => generated 1368 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:20.518959 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-b6a5770c-226f-4c1c-96c4-71f6059fbf43 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:20.519591 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-b6a5770c-226f-4c1c-96c4-71f6059fbf43 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] [instance: 6be25faa-d7aa-4bd8-9bc5-b1f2615b1fea] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:20.526061 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-b6a5770c-226f-4c1c-96c4-71f6059fbf43 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:20.526540 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-b6a5770c-226f-4c1c-96c4-71f6059fbf43 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:20.526972 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-b6a5770c-226f-4c1c-96c4-71f6059fbf43 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:20.527655 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-b6a5770c-226f-4c1c-96c4-71f6059fbf43 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:20.528135 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-b6a5770c-226f-4c1c-96c4-71f6059fbf43 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:20.528557 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-b6a5770c-226f-4c1c-96c4-71f6059fbf43 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:20.657365 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-b6a5770c-226f-4c1c-96c4-71f6059fbf43 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38ce75423b5412d90c1158396978b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e60d7c624e49e1bb43188ae9d7dd2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:20.665623 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-b6a5770c-226f-4c1c-96c4-71f6059fbf43 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] 10.222.0.52 "GET /compute/v2.1/servers/6be25faa-d7aa-4bd8-9bc5-b1f2615b1fea" status: 200 len: 1368 microversion: 2.1 time: 0.150591 Oct 28 09:56:20.666432 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 456/895] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:20 2022] GET /compute/v2.1/servers/6be25faa-d7aa-4bd8-9bc5-b1f2615b1fea => generated 1368 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:21.688602 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-4b650cff-cea3-409b-a249-e9c4f9ba5e26 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:21.689203 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-4b650cff-cea3-409b-a249-e9c4f9ba5e26 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] [instance: 6be25faa-d7aa-4bd8-9bc5-b1f2615b1fea] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:21.696343 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-4b650cff-cea3-409b-a249-e9c4f9ba5e26 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:21.696821 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-4b650cff-cea3-409b-a249-e9c4f9ba5e26 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:21.697253 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-4b650cff-cea3-409b-a249-e9c4f9ba5e26 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:21.697936 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-4b650cff-cea3-409b-a249-e9c4f9ba5e26 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:21.698391 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-4b650cff-cea3-409b-a249-e9c4f9ba5e26 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:21.698808 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-4b650cff-cea3-409b-a249-e9c4f9ba5e26 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:21.827888 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-4b650cff-cea3-409b-a249-e9c4f9ba5e26 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38ce75423b5412d90c1158396978b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e60d7c624e49e1bb43188ae9d7dd2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:21.836368 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-4b650cff-cea3-409b-a249-e9c4f9ba5e26 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] 10.222.0.52 "GET /compute/v2.1/servers/6be25faa-d7aa-4bd8-9bc5-b1f2615b1fea" status: 200 len: 1368 microversion: 2.1 time: 0.151558 Oct 28 09:56:21.837299 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 440/896] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:21 2022] GET /compute/v2.1/servers/6be25faa-d7aa-4bd8-9bc5-b1f2615b1fea => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:22.861206 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-cf4e9408-8034-4d9e-9b5a-9a3734a6b80f tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:22.862571 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-cf4e9408-8034-4d9e-9b5a-9a3734a6b80f tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] [instance: 6be25faa-d7aa-4bd8-9bc5-b1f2615b1fea] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:22.870854 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-cf4e9408-8034-4d9e-9b5a-9a3734a6b80f tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:22.871346 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-cf4e9408-8034-4d9e-9b5a-9a3734a6b80f tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:22.871807 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-cf4e9408-8034-4d9e-9b5a-9a3734a6b80f tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:22.872517 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-cf4e9408-8034-4d9e-9b5a-9a3734a6b80f tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:22.872976 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-cf4e9408-8034-4d9e-9b5a-9a3734a6b80f tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:22.873399 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-cf4e9408-8034-4d9e-9b5a-9a3734a6b80f tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:23.011335 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-cf4e9408-8034-4d9e-9b5a-9a3734a6b80f tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38ce75423b5412d90c1158396978b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e60d7c624e49e1bb43188ae9d7dd2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:23.014980 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG dbcounter [-] [127032] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:56:23.020368 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-cf4e9408-8034-4d9e-9b5a-9a3734a6b80f tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] 10.222.0.52 "GET /compute/v2.1/servers/6be25faa-d7aa-4bd8-9bc5-b1f2615b1fea" status: 200 len: 1368 microversion: 2.1 time: 0.163811 Oct 28 09:56:23.021107 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 457/897] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:22 2022] GET /compute/v2.1/servers/6be25faa-d7aa-4bd8-9bc5-b1f2615b1fea => generated 1368 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:23.347913 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [req-ce6fb809-e3a7-4e05-9c7e-081c336d8162 req-ad247747-2448-48a9-ac54-bf40d0b3f13d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6be25faa-d7aa-4bd8-9bc5-b1f2615b1fea", "name": "network-vif-plugged", "status": "completed", "tag": "4ebb832d-2608-4bca-83d7-11d81dded89a"}]} {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:56:23.358436 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-ce6fb809-e3a7-4e05-9c7e-081c336d8162 req-ad247747-2448-48a9-ac54-bf40d0b3f13d service nova] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:23.358915 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-ce6fb809-e3a7-4e05-9c7e-081c336d8162 req-ad247747-2448-48a9-ac54-bf40d0b3f13d service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:23.359402 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-ce6fb809-e3a7-4e05-9c7e-081c336d8162 req-ad247747-2448-48a9-ac54-bf40d0b3f13d service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:23.371973 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.compute.server_external_events [req-ce6fb809-e3a7-4e05-9c7e-081c336d8162 req-ad247747-2448-48a9-ac54-bf40d0b3f13d service nova] Creating event network-vif-plugged:4ebb832d-2608-4bca-83d7-11d81dded89a for instance 6be25faa-d7aa-4bd8-9bc5-b1f2615b1fea on hv-cinder-zed-3 Oct 28 09:56:23.377018 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [req-ce6fb809-e3a7-4e05-9c7e-081c336d8162 req-ad247747-2448-48a9-ac54-bf40d0b3f13d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088240 Oct 28 09:56:23.377870 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 441/898] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Oct 28 09:56:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:56:24.044777 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-189e73cd-f674-49a0-886d-39ffbcebe547 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:24.045209 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-189e73cd-f674-49a0-886d-39ffbcebe547 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] [instance: 6be25faa-d7aa-4bd8-9bc5-b1f2615b1fea] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:24.046985 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG dbcounter [-] [127032] Writing DB stats nova_cell0:SELECT=2 {{(pid=127032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:56:24.047614 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG dbcounter [-] [127032] Writing DB stats nova_cell0:SELECT=10 {{(pid=127032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:56:24.054957 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-189e73cd-f674-49a0-886d-39ffbcebe547 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:24.055367 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-189e73cd-f674-49a0-886d-39ffbcebe547 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:24.055825 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-189e73cd-f674-49a0-886d-39ffbcebe547 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:24.056649 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-189e73cd-f674-49a0-886d-39ffbcebe547 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:24.057094 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-189e73cd-f674-49a0-886d-39ffbcebe547 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:24.057511 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-189e73cd-f674-49a0-886d-39ffbcebe547 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:24.186985 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-189e73cd-f674-49a0-886d-39ffbcebe547 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38ce75423b5412d90c1158396978b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e60d7c624e49e1bb43188ae9d7dd2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:24.195467 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-189e73cd-f674-49a0-886d-39ffbcebe547 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] 10.222.0.52 "GET /compute/v2.1/servers/6be25faa-d7aa-4bd8-9bc5-b1f2615b1fea" status: 200 len: 1368 microversion: 2.1 time: 0.155735 Oct 28 09:56:24.196077 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 458/899] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:24 2022] GET /compute/v2.1/servers/6be25faa-d7aa-4bd8-9bc5-b1f2615b1fea => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:25.219237 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-3e9a0d5c-f8f2-40e7-bf7f-44c3c5e61d37 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:25.219965 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-3e9a0d5c-f8f2-40e7-bf7f-44c3c5e61d37 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] [instance: 6be25faa-d7aa-4bd8-9bc5-b1f2615b1fea] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:25.221907 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG dbcounter [-] [127033] Writing DB stats nova_cell0:SELECT=2 {{(pid=127033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:56:25.227997 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-3e9a0d5c-f8f2-40e7-bf7f-44c3c5e61d37 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:25.228490 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-3e9a0d5c-f8f2-40e7-bf7f-44c3c5e61d37 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:25.228925 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-3e9a0d5c-f8f2-40e7-bf7f-44c3c5e61d37 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:25.229617 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-3e9a0d5c-f8f2-40e7-bf7f-44c3c5e61d37 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:25.230075 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-3e9a0d5c-f8f2-40e7-bf7f-44c3c5e61d37 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:25.230504 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-3e9a0d5c-f8f2-40e7-bf7f-44c3c5e61d37 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:25.361236 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-3e9a0d5c-f8f2-40e7-bf7f-44c3c5e61d37 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38ce75423b5412d90c1158396978b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e60d7c624e49e1bb43188ae9d7dd2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:25.369527 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-3e9a0d5c-f8f2-40e7-bf7f-44c3c5e61d37 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] 10.222.0.52 "GET /compute/v2.1/servers/6be25faa-d7aa-4bd8-9bc5-b1f2615b1fea" status: 200 len: 1368 microversion: 2.1 time: 0.154509 Oct 28 09:56:25.370096 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 442/900] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:25 2022] GET /compute/v2.1/servers/6be25faa-d7aa-4bd8-9bc5-b1f2615b1fea => generated 1368 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:26.394176 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-fbc1b11f-eb10-4cd4-8ec7-810688a98a12 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:26.394801 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-fbc1b11f-eb10-4cd4-8ec7-810688a98a12 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] [instance: 6be25faa-d7aa-4bd8-9bc5-b1f2615b1fea] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:26.401266 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-fbc1b11f-eb10-4cd4-8ec7-810688a98a12 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:26.401690 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-fbc1b11f-eb10-4cd4-8ec7-810688a98a12 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:26.402128 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-fbc1b11f-eb10-4cd4-8ec7-810688a98a12 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:26.402822 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-fbc1b11f-eb10-4cd4-8ec7-810688a98a12 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:26.403285 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-fbc1b11f-eb10-4cd4-8ec7-810688a98a12 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:26.403710 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-fbc1b11f-eb10-4cd4-8ec7-810688a98a12 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:26.534418 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-fbc1b11f-eb10-4cd4-8ec7-810688a98a12 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38ce75423b5412d90c1158396978b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e60d7c624e49e1bb43188ae9d7dd2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:26.542163 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-fbc1b11f-eb10-4cd4-8ec7-810688a98a12 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] 10.222.0.52 "GET /compute/v2.1/servers/6be25faa-d7aa-4bd8-9bc5-b1f2615b1fea" status: 200 len: 1557 microversion: 2.1 time: 0.152550 Oct 28 09:56:26.542731 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 459/901] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:26 2022] GET /compute/v2.1/servers/6be25faa-d7aa-4bd8-9bc5-b1f2615b1fea => generated 1557 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:26.564452 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-d71c7b1a-09ca-4de0-9b35-b74221bda973 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:26.565569 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-d71c7b1a-09ca-4de0-9b35-b74221bda973 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] [instance: 6be25faa-d7aa-4bd8-9bc5-b1f2615b1fea] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:26.571786 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-d71c7b1a-09ca-4de0-9b35-b74221bda973 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:26.572268 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-d71c7b1a-09ca-4de0-9b35-b74221bda973 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:26.572696 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-d71c7b1a-09ca-4de0-9b35-b74221bda973 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:26.573377 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-d71c7b1a-09ca-4de0-9b35-b74221bda973 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:26.573828 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-d71c7b1a-09ca-4de0-9b35-b74221bda973 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:26.574241 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-d71c7b1a-09ca-4de0-9b35-b74221bda973 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:26.650620 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-d71c7b1a-09ca-4de0-9b35-b74221bda973 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] 10.222.0.52 "GET /compute/v2.1/servers/6be25faa-d7aa-4bd8-9bc5-b1f2615b1fea/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089938 Oct 28 09:56:26.651215 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 443/902] 10.222.0.52 () {58 vars in 1275 bytes} [Fri Oct 28 09:56:26 2022] GET /compute/v2.1/servers/6be25faa-d7aa-4bd8-9bc5-b1f2615b1fea/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:56:27.555089 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [req-8b3b89c8-3715-4182-951b-b6b499e9977a req-716fae33-3875-45b5-ae96-0d1b2e0575ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6be25faa-d7aa-4bd8-9bc5-b1f2615b1fea", "tag": "4ebb832d-2608-4bca-83d7-11d81dded89a"}]} {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:56:27.565704 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-8b3b89c8-3715-4182-951b-b6b499e9977a req-716fae33-3875-45b5-ae96-0d1b2e0575ef service nova] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:27.566212 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-8b3b89c8-3715-4182-951b-b6b499e9977a req-716fae33-3875-45b5-ae96-0d1b2e0575ef service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:27.566636 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-8b3b89c8-3715-4182-951b-b6b499e9977a req-716fae33-3875-45b5-ae96-0d1b2e0575ef service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:27.577846 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.compute.server_external_events [req-8b3b89c8-3715-4182-951b-b6b499e9977a req-716fae33-3875-45b5-ae96-0d1b2e0575ef service nova] Creating event network-changed:4ebb832d-2608-4bca-83d7-11d81dded89a for instance 6be25faa-d7aa-4bd8-9bc5-b1f2615b1fea on hv-cinder-zed-3 Oct 28 09:56:27.583103 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [req-8b3b89c8-3715-4182-951b-b6b499e9977a req-716fae33-3875-45b5-ae96-0d1b2e0575ef service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031526 Oct 28 09:56:27.583707 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 460/903] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Oct 28 09:56:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:57:29.365890 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG dbcounter [-] [127033] Writing DB stats nova_api:SELECT=17 {{(pid=127033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:57:29.366563 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG dbcounter [-] [127033] Writing DB stats nova_cell1:SELECT=30 {{(pid=127033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:57:29.371694 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-1c1577ff-99ca-4dba-b0d9-4d914cf8ab90 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:57:29.374267 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-1c1577ff-99ca-4dba-b0d9-4d914cf8ab90 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] [instance: ad989c34-1973-42cb-82ea-637973bf8d4f] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:29.381290 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-1c1577ff-99ca-4dba-b0d9-4d914cf8ab90 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:29.381903 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-1c1577ff-99ca-4dba-b0d9-4d914cf8ab90 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:29.382222 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-1c1577ff-99ca-4dba-b0d9-4d914cf8ab90 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:29.383080 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-1c1577ff-99ca-4dba-b0d9-4d914cf8ab90 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:29.383569 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-1c1577ff-99ca-4dba-b0d9-4d914cf8ab90 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:29.384107 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-1c1577ff-99ca-4dba-b0d9-4d914cf8ab90 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:29.456875 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-1c1577ff-99ca-4dba-b0d9-4d914cf8ab90 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] 10.222.0.52 "POST /compute/v2.1/servers/ad989c34-1973-42cb-82ea-637973bf8d4f/action" status: 202 len: 0 microversion: 2.1 time: 0.092360 Oct 28 09:57:29.460989 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 444/904] 10.222.0.52 () {60 vars in 1278 bytes} [Fri Oct 28 09:57:29 2022] POST /compute/v2.1/servers/ad989c34-1973-42cb-82ea-637973bf8d4f/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:57:29.467632 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG dbcounter [-] [127032] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=127032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:57:29.468399 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG dbcounter [-] [127032] Writing DB stats nova_cell1:SELECT=14 {{(pid=127032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:57:29.472789 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-78303277-57c6-4a47-b19a-4c6edbb5687d tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:29.473481 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-78303277-57c6-4a47-b19a-4c6edbb5687d tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] [instance: ad989c34-1973-42cb-82ea-637973bf8d4f] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:29.480636 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-78303277-57c6-4a47-b19a-4c6edbb5687d tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:29.481120 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-78303277-57c6-4a47-b19a-4c6edbb5687d tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:29.481547 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-78303277-57c6-4a47-b19a-4c6edbb5687d tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:29.482233 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-78303277-57c6-4a47-b19a-4c6edbb5687d tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:29.482685 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-78303277-57c6-4a47-b19a-4c6edbb5687d tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:29.483101 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-78303277-57c6-4a47-b19a-4c6edbb5687d tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:29.633681 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-78303277-57c6-4a47-b19a-4c6edbb5687d tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2771d02bec4465d94e98134015b9705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1659fef961ae4ccda1adf6b62c018c9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:29.642842 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-78303277-57c6-4a47-b19a-4c6edbb5687d tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] 10.222.0.52 "GET /compute/v2.1/servers/ad989c34-1973-42cb-82ea-637973bf8d4f" status: 200 len: 1752 microversion: 2.1 time: 0.177459 Oct 28 09:57:29.643488 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 461/905] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:57:29 2022] GET /compute/v2.1/servers/ad989c34-1973-42cb-82ea-637973bf8d4f => generated 1752 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:57:30.667266 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-b0ae0ec7-50a3-4945-be2b-ee67b47ef99a tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:30.668154 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-b0ae0ec7-50a3-4945-be2b-ee67b47ef99a tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] [instance: ad989c34-1973-42cb-82ea-637973bf8d4f] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:30.674687 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-b0ae0ec7-50a3-4945-be2b-ee67b47ef99a tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:30.675160 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-b0ae0ec7-50a3-4945-be2b-ee67b47ef99a tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:30.675584 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-b0ae0ec7-50a3-4945-be2b-ee67b47ef99a tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:30.676298 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-b0ae0ec7-50a3-4945-be2b-ee67b47ef99a tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:30.676748 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-b0ae0ec7-50a3-4945-be2b-ee67b47ef99a tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:30.677167 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-b0ae0ec7-50a3-4945-be2b-ee67b47ef99a tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:30.817840 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-b0ae0ec7-50a3-4945-be2b-ee67b47ef99a tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2771d02bec4465d94e98134015b9705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1659fef961ae4ccda1adf6b62c018c9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:30.826648 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-b0ae0ec7-50a3-4945-be2b-ee67b47ef99a tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] 10.222.0.52 "GET /compute/v2.1/servers/ad989c34-1973-42cb-82ea-637973bf8d4f" status: 200 len: 1757 microversion: 2.1 time: 0.164153 Oct 28 09:57:30.827203 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 445/906] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:57:30 2022] GET /compute/v2.1/servers/ad989c34-1973-42cb-82ea-637973bf8d4f => generated 1757 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:57:31.850843 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-5b972ae7-33b9-486c-aeda-72845742b534 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:31.851453 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-5b972ae7-33b9-486c-aeda-72845742b534 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] [instance: ad989c34-1973-42cb-82ea-637973bf8d4f] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:31.858251 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-5b972ae7-33b9-486c-aeda-72845742b534 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:31.858736 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-5b972ae7-33b9-486c-aeda-72845742b534 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:31.859164 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-5b972ae7-33b9-486c-aeda-72845742b534 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:31.859893 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-5b972ae7-33b9-486c-aeda-72845742b534 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:31.860333 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-5b972ae7-33b9-486c-aeda-72845742b534 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:31.860757 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-5b972ae7-33b9-486c-aeda-72845742b534 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:32.005005 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-5b972ae7-33b9-486c-aeda-72845742b534 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2771d02bec4465d94e98134015b9705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1659fef961ae4ccda1adf6b62c018c9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:32.013918 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-5b972ae7-33b9-486c-aeda-72845742b534 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] 10.222.0.52 "GET /compute/v2.1/servers/ad989c34-1973-42cb-82ea-637973bf8d4f" status: 200 len: 1757 microversion: 2.1 time: 0.167361 Oct 28 09:57:32.014493 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 462/907] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:57:31 2022] GET /compute/v2.1/servers/ad989c34-1973-42cb-82ea-637973bf8d4f => generated 1757 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:57:33.037409 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-9a82eb45-129c-48f8-8df9-5a039e509623 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:33.038022 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-9a82eb45-129c-48f8-8df9-5a039e509623 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] [instance: ad989c34-1973-42cb-82ea-637973bf8d4f] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:33.045117 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-9a82eb45-129c-48f8-8df9-5a039e509623 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:33.045608 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-9a82eb45-129c-48f8-8df9-5a039e509623 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:33.046047 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-9a82eb45-129c-48f8-8df9-5a039e509623 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:33.046740 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-9a82eb45-129c-48f8-8df9-5a039e509623 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:33.047197 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-9a82eb45-129c-48f8-8df9-5a039e509623 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:33.047624 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-9a82eb45-129c-48f8-8df9-5a039e509623 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:33.189781 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-9a82eb45-129c-48f8-8df9-5a039e509623 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2771d02bec4465d94e98134015b9705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1659fef961ae4ccda1adf6b62c018c9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:33.198070 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-9a82eb45-129c-48f8-8df9-5a039e509623 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] 10.222.0.52 "GET /compute/v2.1/servers/ad989c34-1973-42cb-82ea-637973bf8d4f" status: 200 len: 1757 microversion: 2.1 time: 0.164572 Oct 28 09:57:33.198633 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 446/908] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:57:33 2022] GET /compute/v2.1/servers/ad989c34-1973-42cb-82ea-637973bf8d4f => generated 1757 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:57:34.221842 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-305e40b3-f556-4d39-89cf-b45e125e1d46 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:34.222434 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-305e40b3-f556-4d39-89cf-b45e125e1d46 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] [instance: ad989c34-1973-42cb-82ea-637973bf8d4f] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:34.228892 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-305e40b3-f556-4d39-89cf-b45e125e1d46 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:34.229376 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-305e40b3-f556-4d39-89cf-b45e125e1d46 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:34.229814 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-305e40b3-f556-4d39-89cf-b45e125e1d46 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:34.230508 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-305e40b3-f556-4d39-89cf-b45e125e1d46 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:34.230965 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-305e40b3-f556-4d39-89cf-b45e125e1d46 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:34.231388 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-305e40b3-f556-4d39-89cf-b45e125e1d46 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:34.374622 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-305e40b3-f556-4d39-89cf-b45e125e1d46 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2771d02bec4465d94e98134015b9705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1659fef961ae4ccda1adf6b62c018c9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:34.382861 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-305e40b3-f556-4d39-89cf-b45e125e1d46 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] 10.222.0.52 "GET /compute/v2.1/servers/ad989c34-1973-42cb-82ea-637973bf8d4f" status: 200 len: 1757 microversion: 2.1 time: 0.164918 Oct 28 09:57:34.383429 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 463/909] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:57:34 2022] GET /compute/v2.1/servers/ad989c34-1973-42cb-82ea-637973bf8d4f => generated 1757 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:57:35.406736 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-14cf1ed9-a538-4b4e-8a1a-cf9863845ecf tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:35.407275 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-14cf1ed9-a538-4b4e-8a1a-cf9863845ecf tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] [instance: ad989c34-1973-42cb-82ea-637973bf8d4f] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:35.413620 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-14cf1ed9-a538-4b4e-8a1a-cf9863845ecf tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:35.414096 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-14cf1ed9-a538-4b4e-8a1a-cf9863845ecf tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:35.414525 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-14cf1ed9-a538-4b4e-8a1a-cf9863845ecf tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:35.415210 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-14cf1ed9-a538-4b4e-8a1a-cf9863845ecf tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:35.415652 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-14cf1ed9-a538-4b4e-8a1a-cf9863845ecf tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:35.416153 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-14cf1ed9-a538-4b4e-8a1a-cf9863845ecf tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:35.562872 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-14cf1ed9-a538-4b4e-8a1a-cf9863845ecf tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2771d02bec4465d94e98134015b9705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1659fef961ae4ccda1adf6b62c018c9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:35.571452 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-14cf1ed9-a538-4b4e-8a1a-cf9863845ecf tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] 10.222.0.52 "GET /compute/v2.1/servers/ad989c34-1973-42cb-82ea-637973bf8d4f" status: 200 len: 1757 microversion: 2.1 time: 0.168720 Oct 28 09:57:35.572041 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 447/910] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:57:35 2022] GET /compute/v2.1/servers/ad989c34-1973-42cb-82ea-637973bf8d4f => generated 1757 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:57:36.595693 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-4053f4a2-8d79-40a8-8656-0d8f851abc2a tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:36.596333 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-4053f4a2-8d79-40a8-8656-0d8f851abc2a tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] [instance: ad989c34-1973-42cb-82ea-637973bf8d4f] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:36.602714 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-4053f4a2-8d79-40a8-8656-0d8f851abc2a tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:36.603188 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-4053f4a2-8d79-40a8-8656-0d8f851abc2a tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:36.604227 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-4053f4a2-8d79-40a8-8656-0d8f851abc2a tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:36.604905 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-4053f4a2-8d79-40a8-8656-0d8f851abc2a tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:36.605312 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-4053f4a2-8d79-40a8-8656-0d8f851abc2a tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:36.605737 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-4053f4a2-8d79-40a8-8656-0d8f851abc2a tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:36.743951 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-4053f4a2-8d79-40a8-8656-0d8f851abc2a tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2771d02bec4465d94e98134015b9705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1659fef961ae4ccda1adf6b62c018c9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:36.753283 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-4053f4a2-8d79-40a8-8656-0d8f851abc2a tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] 10.222.0.52 "GET /compute/v2.1/servers/ad989c34-1973-42cb-82ea-637973bf8d4f" status: 200 len: 1757 microversion: 2.1 time: 0.161543 Oct 28 09:57:36.753852 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 464/911] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:57:36 2022] GET /compute/v2.1/servers/ad989c34-1973-42cb-82ea-637973bf8d4f => generated 1757 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:57:37.776729 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-96126728-560a-4c21-95cb-1da7a81496d9 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:37.777359 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-96126728-560a-4c21-95cb-1da7a81496d9 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] [instance: ad989c34-1973-42cb-82ea-637973bf8d4f] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:37.783617 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-96126728-560a-4c21-95cb-1da7a81496d9 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:37.784127 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-96126728-560a-4c21-95cb-1da7a81496d9 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:37.784558 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-96126728-560a-4c21-95cb-1da7a81496d9 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:37.785239 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-96126728-560a-4c21-95cb-1da7a81496d9 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:37.785687 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-96126728-560a-4c21-95cb-1da7a81496d9 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:37.786102 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-96126728-560a-4c21-95cb-1da7a81496d9 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:37.927470 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-96126728-560a-4c21-95cb-1da7a81496d9 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2771d02bec4465d94e98134015b9705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1659fef961ae4ccda1adf6b62c018c9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:37.936267 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-96126728-560a-4c21-95cb-1da7a81496d9 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] 10.222.0.52 "GET /compute/v2.1/servers/ad989c34-1973-42cb-82ea-637973bf8d4f" status: 200 len: 1757 microversion: 2.1 time: 0.163499 Oct 28 09:57:37.936835 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 448/912] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:57:37 2022] GET /compute/v2.1/servers/ad989c34-1973-42cb-82ea-637973bf8d4f => generated 1757 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:57:38.961181 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-0527c6e9-c767-4edf-b498-d780c5c21269 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:38.961788 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-0527c6e9-c767-4edf-b498-d780c5c21269 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] [instance: ad989c34-1973-42cb-82ea-637973bf8d4f] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:38.968599 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-0527c6e9-c767-4edf-b498-d780c5c21269 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:38.969076 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-0527c6e9-c767-4edf-b498-d780c5c21269 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:38.969505 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-0527c6e9-c767-4edf-b498-d780c5c21269 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:38.970187 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-0527c6e9-c767-4edf-b498-d780c5c21269 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:38.970637 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-0527c6e9-c767-4edf-b498-d780c5c21269 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:38.971056 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-0527c6e9-c767-4edf-b498-d780c5c21269 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:39.111257 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-0527c6e9-c767-4edf-b498-d780c5c21269 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2771d02bec4465d94e98134015b9705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1659fef961ae4ccda1adf6b62c018c9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:39.119514 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-0527c6e9-c767-4edf-b498-d780c5c21269 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] 10.222.0.52 "GET /compute/v2.1/servers/ad989c34-1973-42cb-82ea-637973bf8d4f" status: 200 len: 1757 microversion: 2.1 time: 0.162421 Oct 28 09:57:39.120109 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 465/913] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:57:38 2022] GET /compute/v2.1/servers/ad989c34-1973-42cb-82ea-637973bf8d4f => generated 1757 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:57:40.143466 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-b21ec97e-2344-444c-8957-f872d8c61b76 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:40.144167 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-b21ec97e-2344-444c-8957-f872d8c61b76 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] [instance: ad989c34-1973-42cb-82ea-637973bf8d4f] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:40.150634 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-b21ec97e-2344-444c-8957-f872d8c61b76 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:40.151114 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-b21ec97e-2344-444c-8957-f872d8c61b76 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:40.151548 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-b21ec97e-2344-444c-8957-f872d8c61b76 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:40.152781 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-b21ec97e-2344-444c-8957-f872d8c61b76 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:40.153258 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-b21ec97e-2344-444c-8957-f872d8c61b76 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:40.153675 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-b21ec97e-2344-444c-8957-f872d8c61b76 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:40.296012 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-b21ec97e-2344-444c-8957-f872d8c61b76 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2771d02bec4465d94e98134015b9705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1659fef961ae4ccda1adf6b62c018c9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:40.304081 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-b21ec97e-2344-444c-8957-f872d8c61b76 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] 10.222.0.52 "GET /compute/v2.1/servers/ad989c34-1973-42cb-82ea-637973bf8d4f" status: 200 len: 1757 microversion: 2.1 time: 0.164488 Oct 28 09:57:40.304641 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 449/914] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:57:40 2022] GET /compute/v2.1/servers/ad989c34-1973-42cb-82ea-637973bf8d4f => generated 1757 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:57:41.327914 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-f3f1d565-0d55-4834-b6b9-79378e8db47d tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:41.328487 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-f3f1d565-0d55-4834-b6b9-79378e8db47d tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] [instance: ad989c34-1973-42cb-82ea-637973bf8d4f] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:41.334920 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-f3f1d565-0d55-4834-b6b9-79378e8db47d tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:41.335402 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-f3f1d565-0d55-4834-b6b9-79378e8db47d tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:41.335865 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-f3f1d565-0d55-4834-b6b9-79378e8db47d tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:41.336563 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-f3f1d565-0d55-4834-b6b9-79378e8db47d tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:41.337017 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-f3f1d565-0d55-4834-b6b9-79378e8db47d tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:41.337439 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-f3f1d565-0d55-4834-b6b9-79378e8db47d tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:41.478739 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-f3f1d565-0d55-4834-b6b9-79378e8db47d tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2771d02bec4465d94e98134015b9705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1659fef961ae4ccda1adf6b62c018c9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:41.487347 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-f3f1d565-0d55-4834-b6b9-79378e8db47d tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] 10.222.0.52 "GET /compute/v2.1/servers/ad989c34-1973-42cb-82ea-637973bf8d4f" status: 200 len: 1760 microversion: 2.1 time: 0.163894 Oct 28 09:57:41.487946 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 466/915] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:57:41 2022] GET /compute/v2.1/servers/ad989c34-1973-42cb-82ea-637973bf8d4f => generated 1760 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:57:42.725497 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-24b46848-3fe5-4b12-aa65-f418e0a09f32 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:42.725978 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-24b46848-3fe5-4b12-aa65-f418e0a09f32 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] [instance: 6be25faa-d7aa-4bd8-9bc5-b1f2615b1fea] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:42.731815 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-24b46848-3fe5-4b12-aa65-f418e0a09f32 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:42.732300 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-24b46848-3fe5-4b12-aa65-f418e0a09f32 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:42.732791 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-24b46848-3fe5-4b12-aa65-f418e0a09f32 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:42.733420 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-24b46848-3fe5-4b12-aa65-f418e0a09f32 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:42.733878 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-24b46848-3fe5-4b12-aa65-f418e0a09f32 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:42.734302 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-24b46848-3fe5-4b12-aa65-f418e0a09f32 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:42.757270 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-24b46848-3fe5-4b12-aa65-f418e0a09f32 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] 10.222.0.52 "GET /compute/v2.1/servers/6be25faa-d7aa-4bd8-9bc5-b1f2615b1fea/ips" status: 200 len: 149 microversion: 2.1 time: 0.084891 Oct 28 09:57:42.757817 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 450/916] 10.222.0.52 () {58 vars in 1248 bytes} [Fri Oct 28 09:57:42 2022] GET /compute/v2.1/servers/6be25faa-d7aa-4bd8-9bc5-b1f2615b1fea/ips => generated 149 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:57:44.095502 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-65beb5a0-769e-4785-9f7a-7ef1a3995b5c tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dda562d8-ddb2-4565-97cd-24bc2002d6ef"}} {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:57:44.097930 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-65beb5a0-769e-4785-9f7a-7ef1a3995b5c tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] [instance: 6be25faa-d7aa-4bd8-9bc5-b1f2615b1fea] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:44.104236 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-65beb5a0-769e-4785-9f7a-7ef1a3995b5c tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:44.104718 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-65beb5a0-769e-4785-9f7a-7ef1a3995b5c tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:44.105150 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-65beb5a0-769e-4785-9f7a-7ef1a3995b5c tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:44.106369 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-65beb5a0-769e-4785-9f7a-7ef1a3995b5c tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:44.106824 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-65beb5a0-769e-4785-9f7a-7ef1a3995b5c tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:44.107238 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-65beb5a0-769e-4785-9f7a-7ef1a3995b5c tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:44.367130 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-65beb5a0-769e-4785-9f7a-7ef1a3995b5c tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] 10.222.0.52 "POST /compute/v2.1/servers/6be25faa-d7aa-4bd8-9bc5-b1f2615b1fea/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.275024 Oct 28 09:57:44.368000 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 467/917] 10.222.0.52 () {60 vars in 1323 bytes} [Fri Oct 28 09:57:44 2022] POST /compute/v2.1/servers/6be25faa-d7aa-4bd8-9bc5-b1f2615b1fea/os-volume_attachments => generated 194 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:57:46.612617 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-b53248d4-145f-4932-9a2c-40c2550ee442 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dda562d8-ddb2-4565-97cd-24bc2002d6ef"}} {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:57:46.615110 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-b53248d4-145f-4932-9a2c-40c2550ee442 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] [instance: 6be25faa-d7aa-4bd8-9bc5-b1f2615b1fea] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:46.621710 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-b53248d4-145f-4932-9a2c-40c2550ee442 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:46.622194 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-b53248d4-145f-4932-9a2c-40c2550ee442 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:46.622627 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-b53248d4-145f-4932-9a2c-40c2550ee442 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:46.623719 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-b53248d4-145f-4932-9a2c-40c2550ee442 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:46.624205 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-b53248d4-145f-4932-9a2c-40c2550ee442 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:46.624631 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-b53248d4-145f-4932-9a2c-40c2550ee442 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:46.705306 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.wsgi [None req-b53248d4-145f-4932-9a2c-40c2550ee442 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] HTTP exception thrown: Invalid volume: volume dda562d8-ddb2-4565-97cd-24bc2002d6ef is already attached to instances: 6be25faa-d7aa-4bd8-9bc5-b1f2615b1fea Oct 28 09:57:46.707046 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-b53248d4-145f-4932-9a2c-40c2550ee442 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Request method failure captured: Oct 28 09:57:46.707046 dv-cinder-zed-3-smb devstack@n-api.service[127033]: request: POST /compute/v2.1/servers/6be25faa-d7aa-4bd8-9bc5-b1f2615b1fea/os-volume_attachments HTTP/1.1 Oct 28 09:57:46.707046 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Accept: application/json Oct 28 09:57:46.707046 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Accept-Encoding: identity Oct 28 09:57:46.707046 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Connection: close Oct 28 09:57:46.707046 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Content-Length: 74 Oct 28 09:57:46.707046 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Content-Type: application/json Oct 28 09:57:46.707046 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Host: 10.222.0.52 Oct 28 09:57:46.707046 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Openstack-System-Scope: None Oct 28 09:57:46.707046 dv-cinder-zed-3-smb devstack@n-api.service[127033]: User-Agent: python-urllib3/1.26.12 Oct 28 09:57:46.707046 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Auth-Token: gAAAAABjW6ZlB_y8UlHttqFpTZf-FQqNFL8UpqBADpRqoMnMvW_jAoL6f5CF8d3TJuqshSrx4zOxOgPBQaaPIBzA2l5d4VliO6WO9dxAWAz2QeafoRTcYtg1CKFv-cJOUbVbMelTlyaihpwFtFOGoW8EkNwvlaaR3DGtxA3ButWLQbGRra0UmvI Oct 28 09:57:46.707046 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Domain-Id: None Oct 28 09:57:46.707046 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Domain-Name: None Oct 28 09:57:46.707046 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Identity-Status: Confirmed Oct 28 09:57:46.707046 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Is-Admin-Project: True Oct 28 09:57:46.707046 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Project-Domain-Id: default Oct 28 09:57:46.707046 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Project-Domain-Name: Default Oct 28 09:57:46.707046 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Project-Id: 68e60d7c624e49e1bb43188ae9d7dd2b Oct 28 09:57:46.707046 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Project-Name: tempest-AttachVolumeNegativeTest-21111899 Oct 28 09:57:46.707046 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Role: reader,member Oct 28 09:57:46.707046 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Roles: reader,member Oct 28 09:57:46.708599 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_68e60d7c624e49e1bb43188ae9d7dd2b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/68e60d7c624e49e1bb43188ae9d7dd2b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/68e60d7c624e49e1bb43188ae9d7dd2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/68e60d7c624e49e1bb43188ae9d7dd2b"}]}] Oct 28 09:57:46.708599 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Tenant: tempest-AttachVolumeNegativeTest-21111899 Oct 28 09:57:46.708599 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Tenant-Id: 68e60d7c624e49e1bb43188ae9d7dd2b Oct 28 09:57:46.708599 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-21111899 Oct 28 09:57:46.708599 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User: tempest-AttachVolumeNegativeTest-21111899-project Oct 28 09:57:46.708599 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User-Domain-Id: default Oct 28 09:57:46.708599 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User-Domain-Name: Default Oct 28 09:57:46.708599 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User-Id: d38ce75423b5412d90c1158396978b97 Oct 28 09:57:46.708599 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User-Name: tempest-AttachVolumeNegativeTest-21111899-project Oct 28 09:57:46.708599 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Oct 28 09:57:46.708599 dv-cinder-zed-3-smb devstack@n-api.service[127033]: {"volumeAttachment": {"volumeId": "dda562d8-ddb2-4565-97cd-24bc2002d6ef"}} Oct 28 09:57:46.708599 dv-cinder-zed-3-smb devstack@n-api.service[127033]: method: > Oct 28 09:57:46.709387 dv-cinder-zed-3-smb devstack@n-api.service[127033]: exception: Invalid volume: volume dda562d8-ddb2-4565-97cd-24bc2002d6ef is already attached to instances: 6be25faa-d7aa-4bd8-9bc5-b1f2615b1fea Oct 28 09:57:46.709387 dv-cinder-zed-3-smb devstack@n-api.service[127033]: action_args: {'server_id': '6be25faa-d7aa-4bd8-9bc5-b1f2615b1fea', 'body': {'volumeAttachment': {'volumeId': 'dda562d8-ddb2-4565-97cd-24bc2002d6ef'}}} Oct 28 09:57:46.709387 dv-cinder-zed-3-smb devstack@n-api.service[127033]: {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:57:46.709387 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:57:46.709387 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 28 09:57:46.709387 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 28 09:57:46.709387 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 28 09:57:46.709387 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 09:57:46.709387 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 28 09:57:46.709387 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 28 09:57:46.709387 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 28 09:57:46.709387 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 28 09:57:46.709387 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 28 09:57:46.709387 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 28 09:57:46.709387 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume dda562d8-ddb2-4565-97cd-24bc2002d6ef is already attached to instances: 6be25faa-d7aa-4bd8-9bc5-b1f2615b1fea Oct 28 09:57:46.709387 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:57:46.709387 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:57:46.709387 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:57:46.709387 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:57:46.710861 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:57:46.710861 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:57:46.710861 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:57:46.710861 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:57:46.710861 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:57:46.710861 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:57:46.710861 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 09:57:46.710861 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 09:57:46.710861 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 09:57:46.710861 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 09:57:46.710861 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 09:57:46.710861 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 09:57:46.710861 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 28 09:57:46.710861 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 28 09:57:46.710861 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume dda562d8-ddb2-4565-97cd-24bc2002d6ef is already attached to instances: 6be25faa-d7aa-4bd8-9bc5-b1f2615b1fea Oct 28 09:57:46.710861 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:57:46.710861 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:57:46.710861 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:57:46.710861 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:57:46.710861 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:57:46.712417 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:57:46.712417 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:57:46.712417 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:57:46.712417 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume dda562d8-ddb2-4565-97cd-24bc2002d6ef is already attached to instances: 6be25faa-d7aa-4bd8-9bc5-b1f2615b1fea Oct 28 09:57:46.712417 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:57:46.712417 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-b53248d4-145f-4932-9a2c-40c2550ee442 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Returning 400 to user: Invalid volume: volume dda562d8-ddb2-4565-97cd-24bc2002d6ef is already attached to instances: 6be25faa-d7aa-4bd8-9bc5-b1f2615b1fea {{(pid=127033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:57:46.712417 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-b53248d4-145f-4932-9a2c-40c2550ee442 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] 10.222.0.52 "POST /compute/v2.1/servers/6be25faa-d7aa-4bd8-9bc5-b1f2615b1fea/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.100666 Oct 28 09:57:46.712417 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 451/918] 10.222.0.52 () {60 vars in 1323 bytes} [Fri Oct 28 09:57:46 2022] POST /compute/v2.1/servers/6be25faa-d7aa-4bd8-9bc5-b1f2615b1fea/os-volume_attachments => generated 174 bytes in 102 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 09:57:46.775051 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-f9cca4cf-edb5-40b4-ba7d-8608dbab3d8a tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:46.775635 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-f9cca4cf-edb5-40b4-ba7d-8608dbab3d8a tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] [instance: 6be25faa-d7aa-4bd8-9bc5-b1f2615b1fea] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:46.783067 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-f9cca4cf-edb5-40b4-ba7d-8608dbab3d8a tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:46.783553 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-f9cca4cf-edb5-40b4-ba7d-8608dbab3d8a tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:46.784022 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-f9cca4cf-edb5-40b4-ba7d-8608dbab3d8a tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:46.784706 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-f9cca4cf-edb5-40b4-ba7d-8608dbab3d8a tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:46.785164 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-f9cca4cf-edb5-40b4-ba7d-8608dbab3d8a tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:46.785591 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-f9cca4cf-edb5-40b4-ba7d-8608dbab3d8a tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:46.864673 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.objects.instance [None req-f9cca4cf-edb5-40b4-ba7d-8608dbab3d8a tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lazy-loading 'services' on Instance uuid 6be25faa-d7aa-4bd8-9bc5-b1f2615b1fea {{(pid=127032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:57:46.939580 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-f9cca4cf-edb5-40b4-ba7d-8608dbab3d8a tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] 10.222.0.52 "DELETE /compute/v2.1/servers/6be25faa-d7aa-4bd8-9bc5-b1f2615b1fea/os-volume_attachments/dda562d8-ddb2-4565-97cd-24bc2002d6ef" status: 202 len: 0 microversion: 2.1 time: 0.168665 Oct 28 09:57:46.940208 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 468/919] 10.222.0.52 () {58 vars in 1416 bytes} [Fri Oct 28 09:57:46 2022] DELETE /compute/v2.1/servers/6be25faa-d7aa-4bd8-9bc5-b1f2615b1fea/os-volume_attachments/dda562d8-ddb2-4565-97cd-24bc2002d6ef => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:57:46.948984 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-23372385-f779-4a20-b0fd-ac34550b4951 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:46.951785 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-23372385-f779-4a20-b0fd-ac34550b4951 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] [instance: 6be25faa-d7aa-4bd8-9bc5-b1f2615b1fea] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:46.959142 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-23372385-f779-4a20-b0fd-ac34550b4951 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:46.959642 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-23372385-f779-4a20-b0fd-ac34550b4951 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:46.960113 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-23372385-f779-4a20-b0fd-ac34550b4951 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:46.961026 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-23372385-f779-4a20-b0fd-ac34550b4951 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:46.961630 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-23372385-f779-4a20-b0fd-ac34550b4951 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:46.962071 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-23372385-f779-4a20-b0fd-ac34550b4951 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:46.992368 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-23372385-f779-4a20-b0fd-ac34550b4951 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] 10.222.0.52 "GET /compute/v2.1/servers/6be25faa-d7aa-4bd8-9bc5-b1f2615b1fea/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047479 Oct 28 09:57:46.992933 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 452/920] 10.222.0.52 () {58 vars in 1302 bytes} [Fri Oct 28 09:57:46 2022] GET /compute/v2.1/servers/6be25faa-d7aa-4bd8-9bc5-b1f2615b1fea/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:57:48.006292 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-8ab9cfac-e619-4d73-bd1a-03578c6fbd2c tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:48.008589 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-8ab9cfac-e619-4d73-bd1a-03578c6fbd2c tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] [instance: 6be25faa-d7aa-4bd8-9bc5-b1f2615b1fea] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:48.015322 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-8ab9cfac-e619-4d73-bd1a-03578c6fbd2c tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:48.015826 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-8ab9cfac-e619-4d73-bd1a-03578c6fbd2c tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:48.016260 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-8ab9cfac-e619-4d73-bd1a-03578c6fbd2c tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:48.016946 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-8ab9cfac-e619-4d73-bd1a-03578c6fbd2c tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:48.017395 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-8ab9cfac-e619-4d73-bd1a-03578c6fbd2c tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:48.017813 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-8ab9cfac-e619-4d73-bd1a-03578c6fbd2c tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:48.047021 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-8ab9cfac-e619-4d73-bd1a-03578c6fbd2c tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] 10.222.0.52 "GET /compute/v2.1/servers/6be25faa-d7aa-4bd8-9bc5-b1f2615b1fea/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045603 Oct 28 09:57:48.047581 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 469/921] 10.222.0.52 () {58 vars in 1302 bytes} [Fri Oct 28 09:57:48 2022] GET /compute/v2.1/servers/6be25faa-d7aa-4bd8-9bc5-b1f2615b1fea/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 09:57:48.111171 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-2cdb66e3-e1ca-4f2b-ac5e-975105cbb000 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:48.111678 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-2cdb66e3-e1ca-4f2b-ac5e-975105cbb000 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] [instance: 6be25faa-d7aa-4bd8-9bc5-b1f2615b1fea] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:48.118114 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-2cdb66e3-e1ca-4f2b-ac5e-975105cbb000 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:48.118596 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-2cdb66e3-e1ca-4f2b-ac5e-975105cbb000 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:48.119032 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-2cdb66e3-e1ca-4f2b-ac5e-975105cbb000 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:48.119722 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-2cdb66e3-e1ca-4f2b-ac5e-975105cbb000 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:48.120286 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-2cdb66e3-e1ca-4f2b-ac5e-975105cbb000 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:48.120709 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-2cdb66e3-e1ca-4f2b-ac5e-975105cbb000 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:48.147066 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-2cdb66e3-e1ca-4f2b-ac5e-975105cbb000 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] [instance: 6be25faa-d7aa-4bd8-9bc5-b1f2615b1fea] Going to try to terminate instance {{(pid=127033) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 09:57:48.223040 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-2cdb66e3-e1ca-4f2b-ac5e-975105cbb000 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] 10.222.0.52 "DELETE /compute/v2.1/servers/6be25faa-d7aa-4bd8-9bc5-b1f2615b1fea" status: 204 len: 0 microversion: 2.1 time: 0.115381 Oct 28 09:57:48.223986 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 453/922] 10.222.0.52 () {58 vars in 1239 bytes} [Fri Oct 28 09:57:48 2022] DELETE /compute/v2.1/servers/6be25faa-d7aa-4bd8-9bc5-b1f2615b1fea => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 28 09:57:48.232106 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-daa08cb4-448f-4c07-91c3-968a7e097422 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:48.232708 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-daa08cb4-448f-4c07-91c3-968a7e097422 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] [instance: 6be25faa-d7aa-4bd8-9bc5-b1f2615b1fea] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:48.238485 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-daa08cb4-448f-4c07-91c3-968a7e097422 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:48.238963 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-daa08cb4-448f-4c07-91c3-968a7e097422 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:48.239431 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-daa08cb4-448f-4c07-91c3-968a7e097422 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:48.240287 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-daa08cb4-448f-4c07-91c3-968a7e097422 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:48.240802 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-daa08cb4-448f-4c07-91c3-968a7e097422 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:48.241219 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-daa08cb4-448f-4c07-91c3-968a7e097422 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:48.371944 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-daa08cb4-448f-4c07-91c3-968a7e097422 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38ce75423b5412d90c1158396978b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e60d7c624e49e1bb43188ae9d7dd2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:48.380480 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-daa08cb4-448f-4c07-91c3-968a7e097422 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] 10.222.0.52 "GET /compute/v2.1/servers/6be25faa-d7aa-4bd8-9bc5-b1f2615b1fea" status: 200 len: 1682 microversion: 2.1 time: 0.152205 Oct 28 09:57:48.381046 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 470/923] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:57:48 2022] GET /compute/v2.1/servers/6be25faa-d7aa-4bd8-9bc5-b1f2615b1fea => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:57:49.405582 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-e95491c8-ce25-4d14-a6cf-51bd3a5a3df2 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:49.406211 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-e95491c8-ce25-4d14-a6cf-51bd3a5a3df2 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] [instance: 6be25faa-d7aa-4bd8-9bc5-b1f2615b1fea] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:49.412306 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-e95491c8-ce25-4d14-a6cf-51bd3a5a3df2 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:49.412795 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-e95491c8-ce25-4d14-a6cf-51bd3a5a3df2 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:49.413233 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-e95491c8-ce25-4d14-a6cf-51bd3a5a3df2 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:49.413924 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-e95491c8-ce25-4d14-a6cf-51bd3a5a3df2 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:49.414387 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-e95491c8-ce25-4d14-a6cf-51bd3a5a3df2 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:49.414809 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-e95491c8-ce25-4d14-a6cf-51bd3a5a3df2 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:49.547570 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-e95491c8-ce25-4d14-a6cf-51bd3a5a3df2 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38ce75423b5412d90c1158396978b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e60d7c624e49e1bb43188ae9d7dd2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:49.555723 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-e95491c8-ce25-4d14-a6cf-51bd3a5a3df2 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] 10.222.0.52 "GET /compute/v2.1/servers/6be25faa-d7aa-4bd8-9bc5-b1f2615b1fea" status: 200 len: 1682 microversion: 2.1 time: 0.154465 Oct 28 09:57:49.556325 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 454/924] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:57:49 2022] GET /compute/v2.1/servers/6be25faa-d7aa-4bd8-9bc5-b1f2615b1fea => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:57:50.582631 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-5723d775-e655-4755-8faf-361a680594d1 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:50.583409 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-5723d775-e655-4755-8faf-361a680594d1 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] [instance: 6be25faa-d7aa-4bd8-9bc5-b1f2615b1fea] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:50.589900 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-5723d775-e655-4755-8faf-361a680594d1 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:50.590390 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-5723d775-e655-4755-8faf-361a680594d1 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:50.590853 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-5723d775-e655-4755-8faf-361a680594d1 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:50.591498 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-5723d775-e655-4755-8faf-361a680594d1 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:50.591973 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-5723d775-e655-4755-8faf-361a680594d1 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:50.592395 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-5723d775-e655-4755-8faf-361a680594d1 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:50.659460 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-5723d775-e655-4755-8faf-361a680594d1 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38ce75423b5412d90c1158396978b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e60d7c624e49e1bb43188ae9d7dd2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:50.667647 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-5723d775-e655-4755-8faf-361a680594d1 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] 10.222.0.52 "GET /compute/v2.1/servers/6be25faa-d7aa-4bd8-9bc5-b1f2615b1fea" status: 200 len: 1614 microversion: 2.1 time: 0.088891 Oct 28 09:57:50.668254 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 471/925] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:57:50 2022] GET /compute/v2.1/servers/6be25faa-d7aa-4bd8-9bc5-b1f2615b1fea => generated 1614 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:57:50.907210 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [req-c959c4e8-efa3-4332-859f-b5317727efa6 req-539ce97a-1c72-41dc-81aa-a5beccffaa0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6be25faa-d7aa-4bd8-9bc5-b1f2615b1fea", "name": "network-vif-deleted", "tag": "4ebb832d-2608-4bca-83d7-11d81dded89a"}]} {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:57:50.918728 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-c959c4e8-efa3-4332-859f-b5317727efa6 req-539ce97a-1c72-41dc-81aa-a5beccffaa0f service nova] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:50.919315 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-c959c4e8-efa3-4332-859f-b5317727efa6 req-539ce97a-1c72-41dc-81aa-a5beccffaa0f service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:50.919848 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-c959c4e8-efa3-4332-859f-b5317727efa6 req-539ce97a-1c72-41dc-81aa-a5beccffaa0f service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:50.941646 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.compute.server_external_events [req-c959c4e8-efa3-4332-859f-b5317727efa6 req-539ce97a-1c72-41dc-81aa-a5beccffaa0f service nova] Creating event network-vif-deleted:4ebb832d-2608-4bca-83d7-11d81dded89a for instance 6be25faa-d7aa-4bd8-9bc5-b1f2615b1fea on hv-cinder-zed-3 Oct 28 09:57:50.947678 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [req-c959c4e8-efa3-4332-859f-b5317727efa6 req-539ce97a-1c72-41dc-81aa-a5beccffaa0f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044999 Oct 28 09:57:50.948540 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 455/926] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Oct 28 09:57:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:57:51.692394 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-95dd3ad9-73d8-48a7-8407-185045a3c300 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:51.693009 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-95dd3ad9-73d8-48a7-8407-185045a3c300 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] [instance: 6be25faa-d7aa-4bd8-9bc5-b1f2615b1fea] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:51.700316 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-95dd3ad9-73d8-48a7-8407-185045a3c300 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:51.700793 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-95dd3ad9-73d8-48a7-8407-185045a3c300 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:51.701227 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-95dd3ad9-73d8-48a7-8407-185045a3c300 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:51.701938 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-95dd3ad9-73d8-48a7-8407-185045a3c300 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:51.702390 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-95dd3ad9-73d8-48a7-8407-185045a3c300 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:51.702815 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-95dd3ad9-73d8-48a7-8407-185045a3c300 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:51.717000 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.wsgi [None req-95dd3ad9-73d8-48a7-8407-185045a3c300 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] HTTP exception thrown: Instance 6be25faa-d7aa-4bd8-9bc5-b1f2615b1fea could not be found. Oct 28 09:57:51.718671 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-95dd3ad9-73d8-48a7-8407-185045a3c300 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Request method failure captured: Oct 28 09:57:51.718671 dv-cinder-zed-3-smb devstack@n-api.service[127032]: request: GET /compute/v2.1/servers/6be25faa-d7aa-4bd8-9bc5-b1f2615b1fea HTTP/1.1 Oct 28 09:57:51.718671 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Accept: application/json Oct 28 09:57:51.718671 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Accept-Encoding: identity Oct 28 09:57:51.718671 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Connection: close Oct 28 09:57:51.718671 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Content-Length: 0 Oct 28 09:57:51.718671 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Content-Type: application/json Oct 28 09:57:51.718671 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Host: 10.222.0.52 Oct 28 09:57:51.718671 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Openstack-System-Scope: None Oct 28 09:57:51.718671 dv-cinder-zed-3-smb devstack@n-api.service[127032]: User-Agent: python-urllib3/1.26.12 Oct 28 09:57:51.718671 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Auth-Token: gAAAAABjW6ZlB_y8UlHttqFpTZf-FQqNFL8UpqBADpRqoMnMvW_jAoL6f5CF8d3TJuqshSrx4zOxOgPBQaaPIBzA2l5d4VliO6WO9dxAWAz2QeafoRTcYtg1CKFv-cJOUbVbMelTlyaihpwFtFOGoW8EkNwvlaaR3DGtxA3ButWLQbGRra0UmvI Oct 28 09:57:51.718671 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Domain-Id: None Oct 28 09:57:51.718671 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Domain-Name: None Oct 28 09:57:51.718671 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Identity-Status: Confirmed Oct 28 09:57:51.718671 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Is-Admin-Project: True Oct 28 09:57:51.718671 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Project-Domain-Id: default Oct 28 09:57:51.718671 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Project-Domain-Name: Default Oct 28 09:57:51.718671 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Project-Id: 68e60d7c624e49e1bb43188ae9d7dd2b Oct 28 09:57:51.718671 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Project-Name: tempest-AttachVolumeNegativeTest-21111899 Oct 28 09:57:51.718671 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Role: reader,member Oct 28 09:57:51.718671 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Roles: reader,member Oct 28 09:57:51.720121 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_68e60d7c624e49e1bb43188ae9d7dd2b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/68e60d7c624e49e1bb43188ae9d7dd2b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/68e60d7c624e49e1bb43188ae9d7dd2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/68e60d7c624e49e1bb43188ae9d7dd2b"}]}] Oct 28 09:57:51.720121 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Tenant: tempest-AttachVolumeNegativeTest-21111899 Oct 28 09:57:51.720121 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Tenant-Id: 68e60d7c624e49e1bb43188ae9d7dd2b Oct 28 09:57:51.720121 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-21111899 Oct 28 09:57:51.720121 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-User: tempest-AttachVolumeNegativeTest-21111899-project Oct 28 09:57:51.720121 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-User-Domain-Id: default Oct 28 09:57:51.720121 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-User-Domain-Name: Default Oct 28 09:57:51.720121 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-User-Id: d38ce75423b5412d90c1158396978b97 Oct 28 09:57:51.720121 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-User-Name: tempest-AttachVolumeNegativeTest-21111899-project Oct 28 09:57:51.720121 dv-cinder-zed-3-smb devstack@n-api.service[127032]: method: > Oct 28 09:57:51.720121 dv-cinder-zed-3-smb devstack@n-api.service[127032]: exception: Instance 6be25faa-d7aa-4bd8-9bc5-b1f2615b1fea could not be found. Oct 28 09:57:51.720121 dv-cinder-zed-3-smb devstack@n-api.service[127032]: action_args: {'id': '6be25faa-d7aa-4bd8-9bc5-b1f2615b1fea'} Oct 28 09:57:51.721231 dv-cinder-zed-3-smb devstack@n-api.service[127032]: {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:57:51.721231 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:57:51.721231 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 09:57:51.721231 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 09:57:51.721231 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 09:57:51.721231 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 09:57:51.721231 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 09:57:51.721231 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 09:57:51.721231 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 09:57:51.721231 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 09:57:51.721231 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6be25faa-d7aa-4bd8-9bc5-b1f2615b1fea could not be found. Oct 28 09:57:51.721231 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Oct 28 09:57:51.721231 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:57:51.721231 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Oct 28 09:57:51.721231 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:57:51.721231 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:57:51.721231 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:57:51.721231 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:57:51.721231 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:57:51.721231 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:57:51.722925 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:57:51.722925 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 09:57:51.722925 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 09:57:51.722925 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 09:57:51.722925 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 09:57:51.722925 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 09:57:51.722925 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 09:57:51.722925 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6be25faa-d7aa-4bd8-9bc5-b1f2615b1fea could not be found. Oct 28 09:57:51.722925 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Oct 28 09:57:51.722925 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:57:51.722925 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Oct 28 09:57:51.722925 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:57:51.722925 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:57:51.722925 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:57:51.722925 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:57:51.722925 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:57:51.722925 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6be25faa-d7aa-4bd8-9bc5-b1f2615b1fea could not be found. Oct 28 09:57:51.722925 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Oct 28 09:57:51.724467 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-95dd3ad9-73d8-48a7-8407-185045a3c300 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Returning 404 to user: Instance 6be25faa-d7aa-4bd8-9bc5-b1f2615b1fea could not be found. {{(pid=127032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:57:51.724467 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-95dd3ad9-73d8-48a7-8407-185045a3c300 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] 10.222.0.52 "GET /compute/v2.1/servers/6be25faa-d7aa-4bd8-9bc5-b1f2615b1fea" status: 404 len: 111 microversion: 2.1 time: 0.031652 Oct 28 09:57:51.724467 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 472/927] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:57:51 2022] GET /compute/v2.1/servers/6be25faa-d7aa-4bd8-9bc5-b1f2615b1fea => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:57:51.729547 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-eed4c0bf-6c65-4f77-9549-b2f39b903085 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Calling method '.version_select at 0x7ff0100ab4c0>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:51.753107 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-eed4c0bf-6c65-4f77-9549-b2f39b903085 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2026557179" status: 202 len: 0 microversion: 2.1 time: 0.027663 Oct 28 09:57:51.753767 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 456/928] 10.222.0.52 () {58 vars in 1221 bytes} [Fri Oct 28 09:57:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2026557179 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:57:52.353936 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-b29db9f2-d09c-47c8-a1c3-4003eff86270 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Action: 'create', calling method: .version_select at 0x7ff01015a790>, body: {"keypair": {"name": "tempest-keypair-922392994", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO+4mfuSHUDsm/CwFT2PsRlHG8eYMt6Sxqb2hN/+S3oV/dvFIoQ1DWV3lUWO0XVeInnwAxOGrqUI2G6NZ+pVyIqDXA6oOZf6UUeOAQnrzijHf/lO7EmYFpFscEmE1HYN+Q=="}} {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:57:52.369043 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.quota [None req-b29db9f2-d09c-47c8-a1c3-4003eff86270 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Getting quotas for project 68e60d7c624e49e1bb43188ae9d7dd2b. Resources: {'key_pairs'} {{(pid=127032) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 09:57:52.372839 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.quota [None req-b29db9f2-d09c-47c8-a1c3-4003eff86270 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Getting quotas for user d38ce75423b5412d90c1158396978b97 and project 68e60d7c624e49e1bb43188ae9d7dd2b. Resources: {'key_pairs'} {{(pid=127032) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 09:57:52.395511 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-b29db9f2-d09c-47c8-a1c3-4003eff86270 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.045389 Oct 28 09:57:52.396409 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 473/929] 10.222.0.52 () {60 vars in 1159 bytes} [Fri Oct 28 09:57:52 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:57:53.583147 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-1f51e1ef-fa57-4185-8c96-6b86a61a1094 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-128657013", "imageRef": "6e314146-a2ed-4f8b-afdd-4f7ed1184d20", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a8c5bacf-14eb-40aa-b7c5-10fa69559527"}], "security_groups": [{"name": "tempest-securitygroup--956114028"}], "key_name": "tempest-keypair-922392994", "user_data": "}} {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:57:53.686103 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.network.neutron [None req-1f51e1ef-fa57-4185-8c96-6b86a61a1094 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] validate_networks() for [('a8c5bacf-14eb-40aa-b7c5-10fa69559527', None, None, None, None, None)] {{(pid=127033) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 09:57:54.116408 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.virt.hardware [None req-1f51e1ef-fa57-4185-8c96-6b86a61a1094 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Flavor limits 0:0:0 {{(pid=127033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 09:57:54.116824 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.virt.hardware [None req-1f51e1ef-fa57-4185-8c96-6b86a61a1094 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Image limits 0:0:0 {{(pid=127033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 09:57:54.117301 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.virt.hardware [None req-1f51e1ef-fa57-4185-8c96-6b86a61a1094 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Flavor pref 0:0:0 {{(pid=127033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 09:57:54.117712 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.virt.hardware [None req-1f51e1ef-fa57-4185-8c96-6b86a61a1094 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Image pref 0:0:0 {{(pid=127033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 09:57:54.118154 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.virt.hardware [None req-1f51e1ef-fa57-4185-8c96-6b86a61a1094 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 09:57:54.127602 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-1f51e1ef-fa57-4185-8c96-6b86a61a1094 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:54.128329 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-1f51e1ef-fa57-4185-8c96-6b86a61a1094 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:54.128768 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-1f51e1ef-fa57-4185-8c96-6b86a61a1094 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:54.129511 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-1f51e1ef-fa57-4185-8c96-6b86a61a1094 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:54.129975 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-1f51e1ef-fa57-4185-8c96-6b86a61a1094 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:54.130401 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-1f51e1ef-fa57-4185-8c96-6b86a61a1094 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:54.147979 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.quota [None req-1f51e1ef-fa57-4185-8c96-6b86a61a1094 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Getting quotas for project 68e60d7c624e49e1bb43188ae9d7dd2b. Resources: {'cores', 'ram', 'instances'} {{(pid=127033) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 09:57:54.152099 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.quota [None req-1f51e1ef-fa57-4185-8c96-6b86a61a1094 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Getting quotas for user d38ce75423b5412d90c1158396978b97 and project 68e60d7c624e49e1bb43188ae9d7dd2b. Resources: {'cores', 'ram', 'instances'} {{(pid=127033) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 09:57:54.163175 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-1f51e1ef-fa57-4185-8c96-6b86a61a1094 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Going to run 1 instances... {{(pid=127033) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 09:57:54.165607 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-1f51e1ef-fa57-4185-8c96-6b86a61a1094 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] [instance: b510dc8e-9a8c-40dd-9efe-c3f6d747c689] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e314146-a2ed-4f8b-afdd-4f7ed1184d20',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127033) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 09:57:54.229377 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-1f51e1ef-fa57-4185-8c96-6b86a61a1094 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.651047 Oct 28 09:57:54.230028 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 457/930] 10.222.0.52 () {60 vars in 1147 bytes} [Fri Oct 28 09:57:53 2022] POST /compute/v2.1/servers => generated 401 bytes in 652 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 09:57:54.241419 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-c158f11e-1f90-41a7-a501-7bb5b256ed13 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:54.242042 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-c158f11e-1f90-41a7-a501-7bb5b256ed13 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] [instance: b510dc8e-9a8c-40dd-9efe-c3f6d747c689] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:54.300022 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-c158f11e-1f90-41a7-a501-7bb5b256ed13 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38ce75423b5412d90c1158396978b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e60d7c624e49e1bb43188ae9d7dd2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:54.306827 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-c158f11e-1f90-41a7-a501-7bb5b256ed13 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] 10.222.0.52 "GET /compute/v2.1/servers/b510dc8e-9a8c-40dd-9efe-c3f6d747c689" status: 200 len: 1240 microversion: 2.1 time: 0.069478 Oct 28 09:57:54.307498 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 474/931] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:57:54 2022] GET /compute/v2.1/servers/b510dc8e-9a8c-40dd-9efe-c3f6d747c689 => generated 1240 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:57:55.331137 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-8a155902-6574-4940-9375-d9130d803f22 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:55.331702 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-8a155902-6574-4940-9375-d9130d803f22 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] [instance: b510dc8e-9a8c-40dd-9efe-c3f6d747c689] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:55.338711 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-8a155902-6574-4940-9375-d9130d803f22 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:55.339202 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-8a155902-6574-4940-9375-d9130d803f22 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:55.339640 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-8a155902-6574-4940-9375-d9130d803f22 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:55.340359 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-8a155902-6574-4940-9375-d9130d803f22 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:55.340823 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-8a155902-6574-4940-9375-d9130d803f22 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:55.341251 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-8a155902-6574-4940-9375-d9130d803f22 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:55.401977 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-8a155902-6574-4940-9375-d9130d803f22 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38ce75423b5412d90c1158396978b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e60d7c624e49e1bb43188ae9d7dd2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:55.409674 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-8a155902-6574-4940-9375-d9130d803f22 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] 10.222.0.52 "GET /compute/v2.1/servers/b510dc8e-9a8c-40dd-9efe-c3f6d747c689" status: 200 len: 1244 microversion: 2.1 time: 0.083147 Oct 28 09:57:55.410228 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 458/932] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:57:55 2022] GET /compute/v2.1/servers/b510dc8e-9a8c-40dd-9efe-c3f6d747c689 => generated 1244 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:57:56.433541 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-be2f182c-7bb4-4163-94b0-8d09983da24e tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:56.434818 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-be2f182c-7bb4-4163-94b0-8d09983da24e tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] [instance: b510dc8e-9a8c-40dd-9efe-c3f6d747c689] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:56.441279 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-be2f182c-7bb4-4163-94b0-8d09983da24e tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:56.442663 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-be2f182c-7bb4-4163-94b0-8d09983da24e tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:56.443064 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-be2f182c-7bb4-4163-94b0-8d09983da24e tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:56.443982 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-be2f182c-7bb4-4163-94b0-8d09983da24e tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:56.444619 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-be2f182c-7bb4-4163-94b0-8d09983da24e tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:56.445317 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-be2f182c-7bb4-4163-94b0-8d09983da24e tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:56.513012 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-be2f182c-7bb4-4163-94b0-8d09983da24e tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38ce75423b5412d90c1158396978b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e60d7c624e49e1bb43188ae9d7dd2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:56.520784 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-be2f182c-7bb4-4163-94b0-8d09983da24e tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] 10.222.0.52 "GET /compute/v2.1/servers/b510dc8e-9a8c-40dd-9efe-c3f6d747c689" status: 200 len: 1298 microversion: 2.1 time: 0.091268 Oct 28 09:57:56.521352 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 475/933] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:57:56 2022] GET /compute/v2.1/servers/b510dc8e-9a8c-40dd-9efe-c3f6d747c689 => generated 1298 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:57:57.544901 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-f3ac8405-71ff-4570-a4f9-70748f256b88 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:57.545675 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-f3ac8405-71ff-4570-a4f9-70748f256b88 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] [instance: b510dc8e-9a8c-40dd-9efe-c3f6d747c689] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:57.552269 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-f3ac8405-71ff-4570-a4f9-70748f256b88 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:57.553056 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-f3ac8405-71ff-4570-a4f9-70748f256b88 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:57.553188 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-f3ac8405-71ff-4570-a4f9-70748f256b88 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:57.553893 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-f3ac8405-71ff-4570-a4f9-70748f256b88 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:57.554385 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-f3ac8405-71ff-4570-a4f9-70748f256b88 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:57.554776 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-f3ac8405-71ff-4570-a4f9-70748f256b88 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:57.684738 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-f3ac8405-71ff-4570-a4f9-70748f256b88 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38ce75423b5412d90c1158396978b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e60d7c624e49e1bb43188ae9d7dd2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:57.692617 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-f3ac8405-71ff-4570-a4f9-70748f256b88 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] 10.222.0.52 "GET /compute/v2.1/servers/b510dc8e-9a8c-40dd-9efe-c3f6d747c689" status: 200 len: 1365 microversion: 2.1 time: 0.151931 Oct 28 09:57:57.693197 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 459/934] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:57:57 2022] GET /compute/v2.1/servers/b510dc8e-9a8c-40dd-9efe-c3f6d747c689 => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:57:57.774839 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [req-2f6ee0b3-47a8-4427-9afd-27e67e2326a5 req-4686b59e-cde4-4453-bc1f-2a467a60f28a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b510dc8e-9a8c-40dd-9efe-c3f6d747c689", "tag": "55670a32-4880-4759-b844-705473cc2214"}]} {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:57:57.785585 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-2f6ee0b3-47a8-4427-9afd-27e67e2326a5 req-4686b59e-cde4-4453-bc1f-2a467a60f28a service nova] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:57.786331 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-2f6ee0b3-47a8-4427-9afd-27e67e2326a5 req-4686b59e-cde4-4453-bc1f-2a467a60f28a service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:57.786762 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-2f6ee0b3-47a8-4427-9afd-27e67e2326a5 req-4686b59e-cde4-4453-bc1f-2a467a60f28a service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:57.798123 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.compute.server_external_events [req-2f6ee0b3-47a8-4427-9afd-27e67e2326a5 req-4686b59e-cde4-4453-bc1f-2a467a60f28a service nova] Creating event network-changed:55670a32-4880-4759-b844-705473cc2214 for instance b510dc8e-9a8c-40dd-9efe-c3f6d747c689 on hv-cinder-zed-3 Oct 28 09:57:57.803311 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [req-2f6ee0b3-47a8-4427-9afd-27e67e2326a5 req-4686b59e-cde4-4453-bc1f-2a467a60f28a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032075 Oct 28 09:57:57.803937 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 476/935] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Oct 28 09:57:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 09:57:58.715861 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-ca87ea98-73ba-44ca-b676-a8d0e16ed340 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:58.716603 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-ca87ea98-73ba-44ca-b676-a8d0e16ed340 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] [instance: b510dc8e-9a8c-40dd-9efe-c3f6d747c689] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:58.722916 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-ca87ea98-73ba-44ca-b676-a8d0e16ed340 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:58.723344 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-ca87ea98-73ba-44ca-b676-a8d0e16ed340 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:58.723800 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-ca87ea98-73ba-44ca-b676-a8d0e16ed340 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:58.724491 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-ca87ea98-73ba-44ca-b676-a8d0e16ed340 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:58.724942 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-ca87ea98-73ba-44ca-b676-a8d0e16ed340 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:58.725365 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-ca87ea98-73ba-44ca-b676-a8d0e16ed340 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:58.742905 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG dbcounter [-] [127033] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:57:58.853820 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-ca87ea98-73ba-44ca-b676-a8d0e16ed340 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38ce75423b5412d90c1158396978b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e60d7c624e49e1bb43188ae9d7dd2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:58.861368 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-ca87ea98-73ba-44ca-b676-a8d0e16ed340 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] 10.222.0.52 "GET /compute/v2.1/servers/b510dc8e-9a8c-40dd-9efe-c3f6d747c689" status: 200 len: 1365 microversion: 2.1 time: 0.149419 Oct 28 09:57:58.861943 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 460/936] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:57:58 2022] GET /compute/v2.1/servers/b510dc8e-9a8c-40dd-9efe-c3f6d747c689 => generated 1365 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:57:59.885878 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-0b8c3d8d-9be7-436a-98df-774cf853837a tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:59.886577 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-0b8c3d8d-9be7-436a-98df-774cf853837a tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] [instance: b510dc8e-9a8c-40dd-9efe-c3f6d747c689] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:59.888593 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG dbcounter [-] [127032] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=1 {{(pid=127032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:57:59.894910 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-0b8c3d8d-9be7-436a-98df-774cf853837a tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:59.895392 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-0b8c3d8d-9be7-436a-98df-774cf853837a tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:59.895859 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-0b8c3d8d-9be7-436a-98df-774cf853837a tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:59.896549 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-0b8c3d8d-9be7-436a-98df-774cf853837a tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:59.897000 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-0b8c3d8d-9be7-436a-98df-774cf853837a tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:59.897422 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-0b8c3d8d-9be7-436a-98df-774cf853837a tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:59.901847 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG dbcounter [-] [127032] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:58:00.029681 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-0b8c3d8d-9be7-436a-98df-774cf853837a tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38ce75423b5412d90c1158396978b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e60d7c624e49e1bb43188ae9d7dd2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:00.037873 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-0b8c3d8d-9be7-436a-98df-774cf853837a tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] 10.222.0.52 "GET /compute/v2.1/servers/b510dc8e-9a8c-40dd-9efe-c3f6d747c689" status: 200 len: 1365 microversion: 2.1 time: 0.156693 Oct 28 09:58:00.038417 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 477/937] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:57:59 2022] GET /compute/v2.1/servers/b510dc8e-9a8c-40dd-9efe-c3f6d747c689 => generated 1365 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:58:01.060710 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-b86915b3-24b9-4b0d-84be-3c336afc3cf7 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:01.061976 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-b86915b3-24b9-4b0d-84be-3c336afc3cf7 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] [instance: b510dc8e-9a8c-40dd-9efe-c3f6d747c689] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:01.064476 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG dbcounter [-] [127033] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:58:01.070219 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-b86915b3-24b9-4b0d-84be-3c336afc3cf7 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:01.070712 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-b86915b3-24b9-4b0d-84be-3c336afc3cf7 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:01.071143 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-b86915b3-24b9-4b0d-84be-3c336afc3cf7 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:01.071879 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-b86915b3-24b9-4b0d-84be-3c336afc3cf7 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:01.072346 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-b86915b3-24b9-4b0d-84be-3c336afc3cf7 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:01.072770 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-b86915b3-24b9-4b0d-84be-3c336afc3cf7 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:01.205041 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-b86915b3-24b9-4b0d-84be-3c336afc3cf7 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38ce75423b5412d90c1158396978b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e60d7c624e49e1bb43188ae9d7dd2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:01.212748 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-b86915b3-24b9-4b0d-84be-3c336afc3cf7 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] 10.222.0.52 "GET /compute/v2.1/servers/b510dc8e-9a8c-40dd-9efe-c3f6d747c689" status: 200 len: 1365 microversion: 2.1 time: 0.156220 Oct 28 09:58:01.213315 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 461/938] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:58:01 2022] GET /compute/v2.1/servers/b510dc8e-9a8c-40dd-9efe-c3f6d747c689 => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:58:02.235487 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-3ee2f1cd-f614-4bd2-aa98-27a7a42c8a78 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:02.236264 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-3ee2f1cd-f614-4bd2-aa98-27a7a42c8a78 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] [instance: b510dc8e-9a8c-40dd-9efe-c3f6d747c689] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:02.242653 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-3ee2f1cd-f614-4bd2-aa98-27a7a42c8a78 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:02.243167 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-3ee2f1cd-f614-4bd2-aa98-27a7a42c8a78 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:02.243591 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-3ee2f1cd-f614-4bd2-aa98-27a7a42c8a78 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:02.244299 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-3ee2f1cd-f614-4bd2-aa98-27a7a42c8a78 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:02.244748 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-3ee2f1cd-f614-4bd2-aa98-27a7a42c8a78 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:02.245164 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-3ee2f1cd-f614-4bd2-aa98-27a7a42c8a78 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:02.373791 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-3ee2f1cd-f614-4bd2-aa98-27a7a42c8a78 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38ce75423b5412d90c1158396978b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e60d7c624e49e1bb43188ae9d7dd2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:02.382089 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-3ee2f1cd-f614-4bd2-aa98-27a7a42c8a78 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] 10.222.0.52 "GET /compute/v2.1/servers/b510dc8e-9a8c-40dd-9efe-c3f6d747c689" status: 200 len: 1365 microversion: 2.1 time: 0.150424 Oct 28 09:58:02.382658 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 478/939] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:58:02 2022] GET /compute/v2.1/servers/b510dc8e-9a8c-40dd-9efe-c3f6d747c689 => generated 1365 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:58:03.406009 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-47e4dac2-1409-475c-828b-9a978b98b984 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:03.406586 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-47e4dac2-1409-475c-828b-9a978b98b984 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] [instance: b510dc8e-9a8c-40dd-9efe-c3f6d747c689] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:03.413166 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-47e4dac2-1409-475c-828b-9a978b98b984 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:03.413655 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-47e4dac2-1409-475c-828b-9a978b98b984 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:03.414089 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-47e4dac2-1409-475c-828b-9a978b98b984 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:03.414789 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-47e4dac2-1409-475c-828b-9a978b98b984 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:03.415247 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-47e4dac2-1409-475c-828b-9a978b98b984 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:03.415672 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-47e4dac2-1409-475c-828b-9a978b98b984 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:03.547606 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-47e4dac2-1409-475c-828b-9a978b98b984 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38ce75423b5412d90c1158396978b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e60d7c624e49e1bb43188ae9d7dd2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:03.555644 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-47e4dac2-1409-475c-828b-9a978b98b984 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] 10.222.0.52 "GET /compute/v2.1/servers/b510dc8e-9a8c-40dd-9efe-c3f6d747c689" status: 200 len: 1365 microversion: 2.1 time: 0.154118 Oct 28 09:58:03.556275 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 462/940] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:58:03 2022] GET /compute/v2.1/servers/b510dc8e-9a8c-40dd-9efe-c3f6d747c689 => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:58:03.667166 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [req-09879edc-be0a-40b5-b512-267f6598f8ea req-64e2d926-d491-4f8b-96ff-3a40619026d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b510dc8e-9a8c-40dd-9efe-c3f6d747c689", "name": "network-vif-plugged", "status": "completed", "tag": "55670a32-4880-4759-b844-705473cc2214"}]} {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:58:03.677358 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-09879edc-be0a-40b5-b512-267f6598f8ea req-64e2d926-d491-4f8b-96ff-3a40619026d7 service nova] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:03.677952 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-09879edc-be0a-40b5-b512-267f6598f8ea req-64e2d926-d491-4f8b-96ff-3a40619026d7 service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:03.678519 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-09879edc-be0a-40b5-b512-267f6598f8ea req-64e2d926-d491-4f8b-96ff-3a40619026d7 service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:03.693265 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.compute.server_external_events [req-09879edc-be0a-40b5-b512-267f6598f8ea req-64e2d926-d491-4f8b-96ff-3a40619026d7 service nova] Creating event network-vif-plugged:55670a32-4880-4759-b844-705473cc2214 for instance b510dc8e-9a8c-40dd-9efe-c3f6d747c689 on hv-cinder-zed-3 Oct 28 09:58:03.698231 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [req-09879edc-be0a-40b5-b512-267f6598f8ea req-64e2d926-d491-4f8b-96ff-3a40619026d7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034825 Oct 28 09:58:03.698874 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 479/941] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Oct 28 09:58:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:58:04.580680 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-bb1bd2bb-73b9-4031-9256-159177eb2abe tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:04.581323 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-bb1bd2bb-73b9-4031-9256-159177eb2abe tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] [instance: b510dc8e-9a8c-40dd-9efe-c3f6d747c689] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:04.583163 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG dbcounter [-] [127033] Writing DB stats nova_cell0:SELECT=2 {{(pid=127033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:58:04.583842 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG dbcounter [-] [127033] Writing DB stats nova_cell0:SELECT=6 {{(pid=127033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:58:04.589954 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-bb1bd2bb-73b9-4031-9256-159177eb2abe tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:04.590432 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-bb1bd2bb-73b9-4031-9256-159177eb2abe tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:04.590856 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-bb1bd2bb-73b9-4031-9256-159177eb2abe tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:04.591575 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-bb1bd2bb-73b9-4031-9256-159177eb2abe tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:04.592062 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-bb1bd2bb-73b9-4031-9256-159177eb2abe tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:04.592589 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-bb1bd2bb-73b9-4031-9256-159177eb2abe tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:04.723859 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-bb1bd2bb-73b9-4031-9256-159177eb2abe tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38ce75423b5412d90c1158396978b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e60d7c624e49e1bb43188ae9d7dd2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:04.731528 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-bb1bd2bb-73b9-4031-9256-159177eb2abe tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] 10.222.0.52 "GET /compute/v2.1/servers/b510dc8e-9a8c-40dd-9efe-c3f6d747c689" status: 200 len: 1365 microversion: 2.1 time: 0.155452 Oct 28 09:58:04.732124 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 463/942] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:58:04 2022] GET /compute/v2.1/servers/b510dc8e-9a8c-40dd-9efe-c3f6d747c689 => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:58:05.752505 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG dbcounter [-] [127032] Writing DB stats nova_cell0:SELECT=6 {{(pid=127032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:58:05.757418 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-9f43cc0c-97f3-4d16-9ba8-cf42afa086a2 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:05.758147 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-9f43cc0c-97f3-4d16-9ba8-cf42afa086a2 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] [instance: b510dc8e-9a8c-40dd-9efe-c3f6d747c689] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:05.764595 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-9f43cc0c-97f3-4d16-9ba8-cf42afa086a2 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:05.765085 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-9f43cc0c-97f3-4d16-9ba8-cf42afa086a2 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:05.765523 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-9f43cc0c-97f3-4d16-9ba8-cf42afa086a2 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:05.766274 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-9f43cc0c-97f3-4d16-9ba8-cf42afa086a2 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:05.766671 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-9f43cc0c-97f3-4d16-9ba8-cf42afa086a2 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:05.767094 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-9f43cc0c-97f3-4d16-9ba8-cf42afa086a2 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:05.902500 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-9f43cc0c-97f3-4d16-9ba8-cf42afa086a2 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38ce75423b5412d90c1158396978b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e60d7c624e49e1bb43188ae9d7dd2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:05.910791 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-9f43cc0c-97f3-4d16-9ba8-cf42afa086a2 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] 10.222.0.52 "GET /compute/v2.1/servers/b510dc8e-9a8c-40dd-9efe-c3f6d747c689" status: 200 len: 1554 microversion: 2.1 time: 0.159277 Oct 28 09:58:05.911353 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 480/943] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:58:05 2022] GET /compute/v2.1/servers/b510dc8e-9a8c-40dd-9efe-c3f6d747c689 => generated 1554 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:58:05.933114 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-b012fc88-ec08-4222-a36f-0a8639da8308 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:05.933768 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-b012fc88-ec08-4222-a36f-0a8639da8308 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] [instance: b510dc8e-9a8c-40dd-9efe-c3f6d747c689] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:05.940458 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-b012fc88-ec08-4222-a36f-0a8639da8308 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:05.940942 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-b012fc88-ec08-4222-a36f-0a8639da8308 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:05.941372 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-b012fc88-ec08-4222-a36f-0a8639da8308 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:05.942058 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-b012fc88-ec08-4222-a36f-0a8639da8308 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:05.942508 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-b012fc88-ec08-4222-a36f-0a8639da8308 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:05.942933 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-b012fc88-ec08-4222-a36f-0a8639da8308 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:06.021943 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-b012fc88-ec08-4222-a36f-0a8639da8308 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] 10.222.0.52 "GET /compute/v2.1/servers/b510dc8e-9a8c-40dd-9efe-c3f6d747c689/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092821 Oct 28 09:58:06.022539 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 464/944] 10.222.0.52 () {58 vars in 1275 bytes} [Fri Oct 28 09:58:05 2022] GET /compute/v2.1/servers/b510dc8e-9a8c-40dd-9efe-c3f6d747c689/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:58:07.192470 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [req-2757eed9-cce6-4553-88b7-af4c5a7e0428 req-725b7e77-8ab1-4cc0-946e-5a8af3a1b12e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b510dc8e-9a8c-40dd-9efe-c3f6d747c689", "tag": "55670a32-4880-4759-b844-705473cc2214"}]} {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:58:07.202926 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-2757eed9-cce6-4553-88b7-af4c5a7e0428 req-725b7e77-8ab1-4cc0-946e-5a8af3a1b12e service nova] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:07.203494 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-2757eed9-cce6-4553-88b7-af4c5a7e0428 req-725b7e77-8ab1-4cc0-946e-5a8af3a1b12e service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:07.203945 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-2757eed9-cce6-4553-88b7-af4c5a7e0428 req-725b7e77-8ab1-4cc0-946e-5a8af3a1b12e service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:07.215769 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.compute.server_external_events [req-2757eed9-cce6-4553-88b7-af4c5a7e0428 req-725b7e77-8ab1-4cc0-946e-5a8af3a1b12e service nova] Creating event network-changed:55670a32-4880-4759-b844-705473cc2214 for instance b510dc8e-9a8c-40dd-9efe-c3f6d747c689 on hv-cinder-zed-3 Oct 28 09:58:07.221572 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [req-2757eed9-cce6-4553-88b7-af4c5a7e0428 req-725b7e77-8ab1-4cc0-946e-5a8af3a1b12e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098296 Oct 28 09:58:07.222188 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 481/945] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Oct 28 09:58:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:58:39.810713 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG dbcounter [-] [127033] Writing DB stats nova_api:SELECT=7 {{(pid=127033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:58:39.811463 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG dbcounter [-] [127033] Writing DB stats nova_cell1:SELECT=24 {{(pid=127033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:58:39.815673 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-0eae6e15-142a-4404-bdab-a3eaa20051ef tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1860808420"}} {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:58:39.816228 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-0eae6e15-142a-4404-bdab-a3eaa20051ef tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] [instance: ad989c34-1973-42cb-82ea-637973bf8d4f] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:39.823107 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-0eae6e15-142a-4404-bdab-a3eaa20051ef tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:39.823598 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-0eae6e15-142a-4404-bdab-a3eaa20051ef tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:39.824064 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-0eae6e15-142a-4404-bdab-a3eaa20051ef tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:39.824806 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-0eae6e15-142a-4404-bdab-a3eaa20051ef tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:39.825255 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-0eae6e15-142a-4404-bdab-a3eaa20051ef tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:39.825676 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-0eae6e15-142a-4404-bdab-a3eaa20051ef tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:39.953595 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.network.security_group_api [None req-0eae6e15-142a-4404-bdab-a3eaa20051ef tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Removing security group d376628a-becb-4670-a2fc-753def2bc8e8 from port 543772b3-bb29-406f-b183-de6fa81a0980 Oct 28 09:58:40.265248 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-0eae6e15-142a-4404-bdab-a3eaa20051ef tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] 10.222.0.52 "POST /compute/v2.1/servers/ad989c34-1973-42cb-82ea-637973bf8d4f/action" status: 202 len: 0 microversion: 2.1 time: 0.455926 Oct 28 09:58:40.265880 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 465/946] 10.222.0.52 () {60 vars in 1278 bytes} [Fri Oct 28 09:58:39 2022] POST /compute/v2.1/servers/ad989c34-1973-42cb-82ea-637973bf8d4f/action => generated 0 bytes in 457 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:58:40.272164 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG dbcounter [-] [127032] Writing DB stats nova_api:SELECT=9 {{(pid=127032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:58:40.273049 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG dbcounter [-] [127032] Writing DB stats nova_cell1:SELECT=21 {{(pid=127032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:58:40.277226 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [req-c98d7f77-33e7-4952-9522-8b66530d3455 req-7bfebe91-4db8-4dce-bbe3-083c27c70ed7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad989c34-1973-42cb-82ea-637973bf8d4f", "tag": "543772b3-bb29-406f-b183-de6fa81a0980"}]} {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:58:40.289595 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-c98d7f77-33e7-4952-9522-8b66530d3455 req-7bfebe91-4db8-4dce-bbe3-083c27c70ed7 service nova] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:40.290075 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-c98d7f77-33e7-4952-9522-8b66530d3455 req-7bfebe91-4db8-4dce-bbe3-083c27c70ed7 service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:40.290503 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-c98d7f77-33e7-4952-9522-8b66530d3455 req-7bfebe91-4db8-4dce-bbe3-083c27c70ed7 service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:40.302467 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.compute.server_external_events [req-c98d7f77-33e7-4952-9522-8b66530d3455 req-7bfebe91-4db8-4dce-bbe3-083c27c70ed7 service nova] Creating event network-changed:543772b3-bb29-406f-b183-de6fa81a0980 for instance ad989c34-1973-42cb-82ea-637973bf8d4f on hv-cinder-zed-3 Oct 28 09:58:40.308428 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [req-c98d7f77-33e7-4952-9522-8b66530d3455 req-7bfebe91-4db8-4dce-bbe3-083c27c70ed7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037560 Oct 28 09:58:40.309404 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 482/947] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Oct 28 09:58:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 09:58:41.419198 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-1624b9bc-cb55-4ae7-87c5-69934548242a tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:41.419738 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-1624b9bc-cb55-4ae7-87c5-69934548242a tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] [instance: ad989c34-1973-42cb-82ea-637973bf8d4f] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:41.425721 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-1624b9bc-cb55-4ae7-87c5-69934548242a tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:41.426206 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-1624b9bc-cb55-4ae7-87c5-69934548242a tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:41.426641 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-1624b9bc-cb55-4ae7-87c5-69934548242a tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:41.427326 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-1624b9bc-cb55-4ae7-87c5-69934548242a tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:41.427802 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-1624b9bc-cb55-4ae7-87c5-69934548242a tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:41.428232 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-1624b9bc-cb55-4ae7-87c5-69934548242a tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:41.509885 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.objects.instance [None req-1624b9bc-cb55-4ae7-87c5-69934548242a tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lazy-loading 'services' on Instance uuid ad989c34-1973-42cb-82ea-637973bf8d4f {{(pid=127033) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:58:41.582618 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-1624b9bc-cb55-4ae7-87c5-69934548242a tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] 10.222.0.52 "DELETE /compute/v2.1/servers/ad989c34-1973-42cb-82ea-637973bf8d4f/os-volume_attachments/9d5d91cc-8deb-4ee2-934e-ed0c68f70722" status: 202 len: 0 microversion: 2.1 time: 0.167662 Oct 28 09:58:41.586355 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 466/948] 10.222.0.52 () {58 vars in 1416 bytes} [Fri Oct 28 09:58:41 2022] DELETE /compute/v2.1/servers/ad989c34-1973-42cb-82ea-637973bf8d4f/os-volume_attachments/9d5d91cc-8deb-4ee2-934e-ed0c68f70722 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:58:41.594228 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-a77aed90-7897-4399-bcd1-57aca6c8b160 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:41.597283 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-a77aed90-7897-4399-bcd1-57aca6c8b160 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] [instance: ad989c34-1973-42cb-82ea-637973bf8d4f] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:41.604943 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-a77aed90-7897-4399-bcd1-57aca6c8b160 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:41.605421 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-a77aed90-7897-4399-bcd1-57aca6c8b160 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:41.605857 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-a77aed90-7897-4399-bcd1-57aca6c8b160 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:41.606566 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-a77aed90-7897-4399-bcd1-57aca6c8b160 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:41.607028 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-a77aed90-7897-4399-bcd1-57aca6c8b160 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:41.607433 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-a77aed90-7897-4399-bcd1-57aca6c8b160 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:41.639124 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-a77aed90-7897-4399-bcd1-57aca6c8b160 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] 10.222.0.52 "GET /compute/v2.1/servers/ad989c34-1973-42cb-82ea-637973bf8d4f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051202 Oct 28 09:58:41.639704 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 483/949] 10.222.0.52 () {58 vars in 1302 bytes} [Fri Oct 28 09:58:41 2022] GET /compute/v2.1/servers/ad989c34-1973-42cb-82ea-637973bf8d4f/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:58:42.324874 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [req-e627b375-0697-4387-91b8-4bb2d8ec7e7b req-1ac4dc42-d25b-4b2e-8a02-ff8f1e27d187 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad989c34-1973-42cb-82ea-637973bf8d4f", "tag": "543772b3-bb29-406f-b183-de6fa81a0980"}]} {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:58:42.337630 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-e627b375-0697-4387-91b8-4bb2d8ec7e7b req-1ac4dc42-d25b-4b2e-8a02-ff8f1e27d187 service nova] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:42.338114 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-e627b375-0697-4387-91b8-4bb2d8ec7e7b req-1ac4dc42-d25b-4b2e-8a02-ff8f1e27d187 service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:42.338745 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-e627b375-0697-4387-91b8-4bb2d8ec7e7b req-1ac4dc42-d25b-4b2e-8a02-ff8f1e27d187 service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:42.350451 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.compute.server_external_events [req-e627b375-0697-4387-91b8-4bb2d8ec7e7b req-1ac4dc42-d25b-4b2e-8a02-ff8f1e27d187 service nova] Creating event network-changed:543772b3-bb29-406f-b183-de6fa81a0980 for instance ad989c34-1973-42cb-82ea-637973bf8d4f on hv-cinder-zed-3 Oct 28 09:58:42.355315 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [req-e627b375-0697-4387-91b8-4bb2d8ec7e7b req-1ac4dc42-d25b-4b2e-8a02-ff8f1e27d187 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034854 Oct 28 09:58:42.355964 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 467/950] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Oct 28 09:58:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:58:42.653041 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-c21b93e1-a879-418f-95bb-a8b1d152c9d4 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:42.655285 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-c21b93e1-a879-418f-95bb-a8b1d152c9d4 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] [instance: ad989c34-1973-42cb-82ea-637973bf8d4f] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:42.661826 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-c21b93e1-a879-418f-95bb-a8b1d152c9d4 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:42.662314 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-c21b93e1-a879-418f-95bb-a8b1d152c9d4 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:42.662750 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-c21b93e1-a879-418f-95bb-a8b1d152c9d4 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:42.663459 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-c21b93e1-a879-418f-95bb-a8b1d152c9d4 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:42.663946 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-c21b93e1-a879-418f-95bb-a8b1d152c9d4 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:42.664380 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-c21b93e1-a879-418f-95bb-a8b1d152c9d4 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:42.696925 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-c21b93e1-a879-418f-95bb-a8b1d152c9d4 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] 10.222.0.52 "GET /compute/v2.1/servers/ad989c34-1973-42cb-82ea-637973bf8d4f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047895 Oct 28 09:58:42.697426 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 484/951] 10.222.0.52 () {58 vars in 1302 bytes} [Fri Oct 28 09:58:42 2022] GET /compute/v2.1/servers/ad989c34-1973-42cb-82ea-637973bf8d4f/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 09:58:42.709071 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-37a54c99-343f-4a5c-865d-67ae4e352c9c tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:42.709648 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-37a54c99-343f-4a5c-865d-67ae4e352c9c tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] [instance: ad989c34-1973-42cb-82ea-637973bf8d4f] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:42.715874 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-37a54c99-343f-4a5c-865d-67ae4e352c9c tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:42.716350 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-37a54c99-343f-4a5c-865d-67ae4e352c9c tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:42.716802 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-37a54c99-343f-4a5c-865d-67ae4e352c9c tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:42.717489 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-37a54c99-343f-4a5c-865d-67ae4e352c9c tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:42.717945 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-37a54c99-343f-4a5c-865d-67ae4e352c9c tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:42.718351 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-37a54c99-343f-4a5c-865d-67ae4e352c9c tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:42.796647 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.wsgi [None req-37a54c99-343f-4a5c-865d-67ae4e352c9c tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] HTTP exception thrown: Instance ad989c34-1973-42cb-82ea-637973bf8d4f is not attached to volume 9d5d91cc-8deb-4ee2-934e-ed0c68f70722 Oct 28 09:58:42.799676 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-37a54c99-343f-4a5c-865d-67ae4e352c9c tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Request method failure captured: Oct 28 09:58:42.799676 dv-cinder-zed-3-smb devstack@n-api.service[127033]: request: DELETE /compute/v2.1/servers/ad989c34-1973-42cb-82ea-637973bf8d4f/os-volume_attachments/9d5d91cc-8deb-4ee2-934e-ed0c68f70722 HTTP/1.1 Oct 28 09:58:42.799676 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Accept: application/json Oct 28 09:58:42.799676 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Accept-Encoding: identity Oct 28 09:58:42.799676 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Connection: close Oct 28 09:58:42.799676 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Content-Length: 0 Oct 28 09:58:42.799676 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Content-Type: application/json Oct 28 09:58:42.799676 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Host: 10.222.0.52 Oct 28 09:58:42.799676 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Openstack-System-Scope: None Oct 28 09:58:42.799676 dv-cinder-zed-3-smb devstack@n-api.service[127033]: User-Agent: python-urllib3/1.26.12 Oct 28 09:58:42.799676 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Auth-Token: gAAAAABjW6cSN6zuLhbI_x-j12n9O9SbwOvKuevZiTjGjX6m0bVlMyrtW_F2VmtIMrPjESioZbjtM6uib7LO_ReaFmkRMrIfWIag_ZajQm-td6G63-9n1T3uyHfQ-ZFXyUT6uB4pcsPunMv2P3JeMPoBqVUe-YqAIDA-4_LZj0Dlr6UND_SoHQs Oct 28 09:58:42.799676 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Domain-Id: None Oct 28 09:58:42.799676 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Domain-Name: None Oct 28 09:58:42.799676 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Identity-Status: Confirmed Oct 28 09:58:42.799676 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Is-Admin-Project: True Oct 28 09:58:42.799676 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Project-Domain-Id: default Oct 28 09:58:42.799676 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Project-Domain-Name: Default Oct 28 09:58:42.799676 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Project-Id: 1659fef961ae4ccda1adf6b62c018c9e Oct 28 09:58:42.799676 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Project-Name: tempest-TestMinimumBasicScenario-1820548896 Oct 28 09:58:42.799676 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Role: reader,member Oct 28 09:58:42.799676 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Roles: reader,member Oct 28 09:58:42.802859 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_1659fef961ae4ccda1adf6b62c018c9e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1659fef961ae4ccda1adf6b62c018c9e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1659fef961ae4ccda1adf6b62c018c9e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/1659fef961ae4ccda1adf6b62c018c9e"}]}] Oct 28 09:58:42.802859 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Tenant: tempest-TestMinimumBasicScenario-1820548896 Oct 28 09:58:42.802859 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Tenant-Id: 1659fef961ae4ccda1adf6b62c018c9e Oct 28 09:58:42.802859 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1820548896 Oct 28 09:58:42.802859 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User: tempest-TestMinimumBasicScenario-1820548896-project Oct 28 09:58:42.802859 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User-Domain-Id: default Oct 28 09:58:42.802859 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User-Domain-Name: Default Oct 28 09:58:42.802859 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User-Id: c2771d02bec4465d94e98134015b9705 Oct 28 09:58:42.802859 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User-Name: tempest-TestMinimumBasicScenario-1820548896-project Oct 28 09:58:42.802859 dv-cinder-zed-3-smb devstack@n-api.service[127033]: method: > Oct 28 09:58:42.802859 dv-cinder-zed-3-smb devstack@n-api.service[127033]: exception: Instance ad989c34-1973-42cb-82ea-637973bf8d4f is not attached to volume 9d5d91cc-8deb-4ee2-934e-ed0c68f70722 Oct 28 09:58:42.804559 dv-cinder-zed-3-smb devstack@n-api.service[127033]: action_args: {'server_id': 'ad989c34-1973-42cb-82ea-637973bf8d4f', 'id': '9d5d91cc-8deb-4ee2-934e-ed0c68f70722'} Oct 28 09:58:42.804559 dv-cinder-zed-3-smb devstack@n-api.service[127033]: {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:58:42.804559 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:58:42.804559 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 28 09:58:42.804559 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 28 09:58:42.804559 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 09:58:42.804559 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 09:58:42.804559 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 28 09:58:42.804559 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 28 09:58:42.804559 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 9d5d91cc-8deb-4ee2-934e-ed0c68f70722. Oct 28 09:58:42.804559 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:58:42.804559 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:58:42.804559 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:58:42.804559 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:58:42.804559 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:58:42.804559 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:58:42.804559 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:58:42.804559 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:58:42.804559 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:58:42.806424 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:58:42.806424 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 28 09:58:42.806424 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 28 09:58:42.806424 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad989c34-1973-42cb-82ea-637973bf8d4f is not attached to volume 9d5d91cc-8deb-4ee2-934e-ed0c68f70722 Oct 28 09:58:42.806424 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:58:42.806424 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:58:42.806424 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:58:42.806424 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:58:42.806424 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:58:42.806424 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:58:42.806424 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:58:42.806424 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:58:42.806424 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad989c34-1973-42cb-82ea-637973bf8d4f is not attached to volume 9d5d91cc-8deb-4ee2-934e-ed0c68f70722 Oct 28 09:58:42.806424 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:58:42.806424 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-37a54c99-343f-4a5c-865d-67ae4e352c9c tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Returning 404 to user: Instance ad989c34-1973-42cb-82ea-637973bf8d4f is not attached to volume 9d5d91cc-8deb-4ee2-934e-ed0c68f70722 {{(pid=127033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:58:42.807502 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-37a54c99-343f-4a5c-865d-67ae4e352c9c tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] 10.222.0.52 "DELETE /compute/v2.1/servers/ad989c34-1973-42cb-82ea-637973bf8d4f/os-volume_attachments/9d5d91cc-8deb-4ee2-934e-ed0c68f70722" status: 404 len: 154 microversion: 2.1 time: 0.096864 Oct 28 09:58:42.807502 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 468/952] 10.222.0.52 () {58 vars in 1416 bytes} [Fri Oct 28 09:58:42 2022] DELETE /compute/v2.1/servers/ad989c34-1973-42cb-82ea-637973bf8d4f/os-volume_attachments/9d5d91cc-8deb-4ee2-934e-ed0c68f70722 => generated 154 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:58:43.961995 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-9900e953-f90d-4ee1-a933-0bccb16f706b tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:43.962508 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-9900e953-f90d-4ee1-a933-0bccb16f706b tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] [instance: ad989c34-1973-42cb-82ea-637973bf8d4f] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:43.968905 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-9900e953-f90d-4ee1-a933-0bccb16f706b tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:43.969400 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-9900e953-f90d-4ee1-a933-0bccb16f706b tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:43.970426 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-9900e953-f90d-4ee1-a933-0bccb16f706b tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:43.971125 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-9900e953-f90d-4ee1-a933-0bccb16f706b tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:43.971580 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-9900e953-f90d-4ee1-a933-0bccb16f706b tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:43.972031 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-9900e953-f90d-4ee1-a933-0bccb16f706b tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:43.997655 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-9900e953-f90d-4ee1-a933-0bccb16f706b tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] [instance: ad989c34-1973-42cb-82ea-637973bf8d4f] Going to try to terminate instance {{(pid=127032) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 09:58:44.076278 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-9900e953-f90d-4ee1-a933-0bccb16f706b tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] 10.222.0.52 "DELETE /compute/v2.1/servers/ad989c34-1973-42cb-82ea-637973bf8d4f" status: 204 len: 0 microversion: 2.1 time: 0.117709 Oct 28 09:58:44.076877 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 485/953] 10.222.0.52 () {58 vars in 1239 bytes} [Fri Oct 28 09:58:43 2022] DELETE /compute/v2.1/servers/ad989c34-1973-42cb-82ea-637973bf8d4f => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 09:58:44.086054 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-cec92aad-cb75-46b3-9355-9d167d6d5ce4 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:44.086668 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-cec92aad-cb75-46b3-9355-9d167d6d5ce4 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] [instance: ad989c34-1973-42cb-82ea-637973bf8d4f] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:44.093247 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-cec92aad-cb75-46b3-9355-9d167d6d5ce4 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:44.093899 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-cec92aad-cb75-46b3-9355-9d167d6d5ce4 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:44.094333 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-cec92aad-cb75-46b3-9355-9d167d6d5ce4 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:44.095654 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-cec92aad-cb75-46b3-9355-9d167d6d5ce4 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:44.096151 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-cec92aad-cb75-46b3-9355-9d167d6d5ce4 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:44.096579 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-cec92aad-cb75-46b3-9355-9d167d6d5ce4 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:44.231500 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-cec92aad-cb75-46b3-9355-9d167d6d5ce4 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2771d02bec4465d94e98134015b9705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1659fef961ae4ccda1adf6b62c018c9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:44.239908 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-cec92aad-cb75-46b3-9355-9d167d6d5ce4 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] 10.222.0.52 "GET /compute/v2.1/servers/ad989c34-1973-42cb-82ea-637973bf8d4f" status: 200 len: 1555 microversion: 2.1 time: 0.158155 Oct 28 09:58:44.240476 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 469/954] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:58:44 2022] GET /compute/v2.1/servers/ad989c34-1973-42cb-82ea-637973bf8d4f => generated 1555 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:58:45.265500 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-203da0a3-20d8-4dce-a699-c800d247af5f tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:45.266241 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-203da0a3-20d8-4dce-a699-c800d247af5f tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] [instance: ad989c34-1973-42cb-82ea-637973bf8d4f] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:45.273501 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-203da0a3-20d8-4dce-a699-c800d247af5f tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:45.273982 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-203da0a3-20d8-4dce-a699-c800d247af5f tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:45.274423 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-203da0a3-20d8-4dce-a699-c800d247af5f tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:45.275135 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-203da0a3-20d8-4dce-a699-c800d247af5f tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:45.275590 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-203da0a3-20d8-4dce-a699-c800d247af5f tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:45.276045 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-203da0a3-20d8-4dce-a699-c800d247af5f tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:45.407762 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-203da0a3-20d8-4dce-a699-c800d247af5f tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2771d02bec4465d94e98134015b9705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1659fef961ae4ccda1adf6b62c018c9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:45.415586 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-203da0a3-20d8-4dce-a699-c800d247af5f tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] 10.222.0.52 "GET /compute/v2.1/servers/ad989c34-1973-42cb-82ea-637973bf8d4f" status: 200 len: 1555 microversion: 2.1 time: 0.154385 Oct 28 09:58:45.416195 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 486/955] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:58:45 2022] GET /compute/v2.1/servers/ad989c34-1973-42cb-82ea-637973bf8d4f => generated 1555 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:58:46.438578 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-3875c6d5-e03b-409f-a262-fce76561233c tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:46.439286 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-3875c6d5-e03b-409f-a262-fce76561233c tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] [instance: ad989c34-1973-42cb-82ea-637973bf8d4f] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:46.445681 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-3875c6d5-e03b-409f-a262-fce76561233c tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:46.446168 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-3875c6d5-e03b-409f-a262-fce76561233c tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:46.446604 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-3875c6d5-e03b-409f-a262-fce76561233c tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:46.447308 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-3875c6d5-e03b-409f-a262-fce76561233c tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:46.447778 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-3875c6d5-e03b-409f-a262-fce76561233c tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:46.448374 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-3875c6d5-e03b-409f-a262-fce76561233c tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:46.587679 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [req-1c629cba-784e-4806-b180-7169dc2d9967 req-8fc93b47-c801-43f8-80d9-a97f36425af9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad989c34-1973-42cb-82ea-637973bf8d4f", "name": "network-vif-deleted", "tag": "543772b3-bb29-406f-b183-de6fa81a0980"}]} {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:58:46.600984 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-3875c6d5-e03b-409f-a262-fce76561233c tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2771d02bec4465d94e98134015b9705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1659fef961ae4ccda1adf6b62c018c9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:46.602803 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-1c629cba-784e-4806-b180-7169dc2d9967 req-8fc93b47-c801-43f8-80d9-a97f36425af9 service nova] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:46.603281 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-1c629cba-784e-4806-b180-7169dc2d9967 req-8fc93b47-c801-43f8-80d9-a97f36425af9 service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:46.604057 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-1c629cba-784e-4806-b180-7169dc2d9967 req-8fc93b47-c801-43f8-80d9-a97f36425af9 service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:46.613496 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-3875c6d5-e03b-409f-a262-fce76561233c tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] 10.222.0.52 "GET /compute/v2.1/servers/ad989c34-1973-42cb-82ea-637973bf8d4f" status: 200 len: 1555 microversion: 2.1 time: 0.178388 Oct 28 09:58:46.615091 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 470/956] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:58:46 2022] GET /compute/v2.1/servers/ad989c34-1973-42cb-82ea-637973bf8d4f => generated 1555 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:58:46.630963 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.compute.server_external_events [req-1c629cba-784e-4806-b180-7169dc2d9967 req-8fc93b47-c801-43f8-80d9-a97f36425af9 service nova] Creating event network-vif-deleted:543772b3-bb29-406f-b183-de6fa81a0980 for instance ad989c34-1973-42cb-82ea-637973bf8d4f on hv-cinder-zed-3 Oct 28 09:58:46.630963 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [req-1c629cba-784e-4806-b180-7169dc2d9967 req-8fc93b47-c801-43f8-80d9-a97f36425af9 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046666 Oct 28 09:58:46.631695 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 487/957] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Oct 28 09:58:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:58:47.640950 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-a713297e-6346-48f2-931a-414e2b72dcf4 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:47.642101 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-a713297e-6346-48f2-931a-414e2b72dcf4 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] [instance: ad989c34-1973-42cb-82ea-637973bf8d4f] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:47.652512 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-a713297e-6346-48f2-931a-414e2b72dcf4 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:47.653352 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-a713297e-6346-48f2-931a-414e2b72dcf4 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:47.654082 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-a713297e-6346-48f2-931a-414e2b72dcf4 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:47.655241 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-a713297e-6346-48f2-931a-414e2b72dcf4 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:47.656094 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-a713297e-6346-48f2-931a-414e2b72dcf4 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:47.657503 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-a713297e-6346-48f2-931a-414e2b72dcf4 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:47.671230 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.wsgi [None req-a713297e-6346-48f2-931a-414e2b72dcf4 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] HTTP exception thrown: Instance ad989c34-1973-42cb-82ea-637973bf8d4f could not be found. Oct 28 09:58:47.673016 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-a713297e-6346-48f2-931a-414e2b72dcf4 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Request method failure captured: Oct 28 09:58:47.673016 dv-cinder-zed-3-smb devstack@n-api.service[127032]: request: GET /compute/v2.1/servers/ad989c34-1973-42cb-82ea-637973bf8d4f HTTP/1.1 Oct 28 09:58:47.673016 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Accept: application/json Oct 28 09:58:47.673016 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Accept-Encoding: identity Oct 28 09:58:47.673016 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Connection: close Oct 28 09:58:47.673016 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Content-Length: 0 Oct 28 09:58:47.673016 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Content-Type: application/json Oct 28 09:58:47.673016 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Host: 10.222.0.52 Oct 28 09:58:47.673016 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Openstack-System-Scope: None Oct 28 09:58:47.673016 dv-cinder-zed-3-smb devstack@n-api.service[127032]: User-Agent: python-urllib3/1.26.12 Oct 28 09:58:47.673016 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Auth-Token: gAAAAABjW6cSN6zuLhbI_x-j12n9O9SbwOvKuevZiTjGjX6m0bVlMyrtW_F2VmtIMrPjESioZbjtM6uib7LO_ReaFmkRMrIfWIag_ZajQm-td6G63-9n1T3uyHfQ-ZFXyUT6uB4pcsPunMv2P3JeMPoBqVUe-YqAIDA-4_LZj0Dlr6UND_SoHQs Oct 28 09:58:47.673016 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Domain-Id: None Oct 28 09:58:47.673016 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Domain-Name: None Oct 28 09:58:47.673016 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Identity-Status: Confirmed Oct 28 09:58:47.673016 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Is-Admin-Project: True Oct 28 09:58:47.673016 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Project-Domain-Id: default Oct 28 09:58:47.673016 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Project-Domain-Name: Default Oct 28 09:58:47.673016 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Project-Id: 1659fef961ae4ccda1adf6b62c018c9e Oct 28 09:58:47.673016 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Project-Name: tempest-TestMinimumBasicScenario-1820548896 Oct 28 09:58:47.673016 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Role: reader,member Oct 28 09:58:47.673016 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Roles: reader,member Oct 28 09:58:47.674634 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_1659fef961ae4ccda1adf6b62c018c9e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1659fef961ae4ccda1adf6b62c018c9e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1659fef961ae4ccda1adf6b62c018c9e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/1659fef961ae4ccda1adf6b62c018c9e"}]}] Oct 28 09:58:47.674634 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Tenant: tempest-TestMinimumBasicScenario-1820548896 Oct 28 09:58:47.674634 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Tenant-Id: 1659fef961ae4ccda1adf6b62c018c9e Oct 28 09:58:47.674634 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1820548896 Oct 28 09:58:47.674634 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-User: tempest-TestMinimumBasicScenario-1820548896-project Oct 28 09:58:47.674634 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-User-Domain-Id: default Oct 28 09:58:47.674634 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-User-Domain-Name: Default Oct 28 09:58:47.674634 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-User-Id: c2771d02bec4465d94e98134015b9705 Oct 28 09:58:47.674634 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-User-Name: tempest-TestMinimumBasicScenario-1820548896-project Oct 28 09:58:47.674634 dv-cinder-zed-3-smb devstack@n-api.service[127032]: method: > Oct 28 09:58:47.674634 dv-cinder-zed-3-smb devstack@n-api.service[127032]: exception: Instance ad989c34-1973-42cb-82ea-637973bf8d4f could not be found. Oct 28 09:58:47.674634 dv-cinder-zed-3-smb devstack@n-api.service[127032]: action_args: {'id': 'ad989c34-1973-42cb-82ea-637973bf8d4f'} Oct 28 09:58:47.675731 dv-cinder-zed-3-smb devstack@n-api.service[127032]: {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:58:47.675731 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:58:47.675731 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 09:58:47.675731 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 09:58:47.675731 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 09:58:47.675731 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 09:58:47.675731 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 09:58:47.675731 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 09:58:47.675731 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 09:58:47.675731 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 09:58:47.675731 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad989c34-1973-42cb-82ea-637973bf8d4f could not be found. Oct 28 09:58:47.675731 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Oct 28 09:58:47.675731 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:58:47.675731 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Oct 28 09:58:47.675731 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:58:47.675731 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:58:47.675731 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:58:47.675731 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:58:47.675731 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:58:47.675731 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:58:47.677273 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:58:47.677273 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 09:58:47.677273 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 09:58:47.677273 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 09:58:47.677273 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 09:58:47.677273 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 09:58:47.677273 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 09:58:47.677273 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad989c34-1973-42cb-82ea-637973bf8d4f could not be found. Oct 28 09:58:47.677273 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Oct 28 09:58:47.677273 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:58:47.677273 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Oct 28 09:58:47.677273 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:58:47.677273 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:58:47.677273 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:58:47.677273 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:58:47.677273 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:58:47.677273 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad989c34-1973-42cb-82ea-637973bf8d4f could not be found. Oct 28 09:58:47.677273 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Oct 28 09:58:47.678813 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-a713297e-6346-48f2-931a-414e2b72dcf4 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Returning 404 to user: Instance ad989c34-1973-42cb-82ea-637973bf8d4f could not be found. {{(pid=127032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:58:47.678813 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-a713297e-6346-48f2-931a-414e2b72dcf4 tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] 10.222.0.52 "GET /compute/v2.1/servers/ad989c34-1973-42cb-82ea-637973bf8d4f" status: 404 len: 111 microversion: 2.1 time: 0.038019 Oct 28 09:58:47.678813 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 488/958] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:58:47 2022] GET /compute/v2.1/servers/ad989c34-1973-42cb-82ea-637973bf8d4f => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:58:47.683191 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-48d3bac8-801f-4615-ae6b-db314002e6ea tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] Calling method '.version_select at 0x7ff013b2eb80>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:47.701893 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-48d3bac8-801f-4615-ae6b-db314002e6ea tempest-TestMinimumBasicScenario-1820548896 tempest-TestMinimumBasicScenario-1820548896-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1587584653" status: 202 len: 0 microversion: 2.1 time: 0.022464 Oct 28 09:58:47.702461 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 471/959] 10.222.0.52 () {58 vars in 1272 bytes} [Fri Oct 28 09:58:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1587584653 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 09:59:05.144643 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG dbcounter [-] [127032] Writing DB stats nova_api:SELECT=19,nova_api:UPDATE=1 {{(pid=127032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:59:05.145839 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG dbcounter [-] [127032] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:59:05.327907 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-11a1f69c-5a88-4e71-9b1d-4cc824105e01 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Action: 'create', calling method: .version_select at 0x7ff0102ef0d0>, body: {"keypair": {"name": "tempest-TestShelveInstance-2097717922", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ0j8dFrvXfPVV7Z5mWh3oCZKvdv63C6xqiZSqiXBL6NII2WwW+o0swufHOO/YJ5cloSGoIigBW1Oc2TZkVoO360bb0YKb2V1r9Zcl4Azwu1qtAEwxixm3jbT4cbBqjkmg=="}} {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:59:05.345085 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.quota [None req-11a1f69c-5a88-4e71-9b1d-4cc824105e01 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Getting quotas for project 3ce53f0f4dec4042a2cd5a3213b82f5f. Resources: {'key_pairs'} {{(pid=127032) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 09:59:05.349900 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.quota [None req-11a1f69c-5a88-4e71-9b1d-4cc824105e01 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Getting quotas for user 5b9bb73c501c444ca98c8af9d7b4c7bd and project 3ce53f0f4dec4042a2cd5a3213b82f5f. Resources: {'key_pairs'} {{(pid=127032) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 09:59:05.374605 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-11a1f69c-5a88-4e71-9b1d-4cc824105e01 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.236219 Oct 28 09:59:05.381810 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 489/960] 10.222.0.52 () {60 vars in 1159 bytes} [Fri Oct 28 09:59:05 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:59:22.303565 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG dbcounter [-] [127033] Writing DB stats nova_cell1:SELECT=33,nova_cell1:INSERT=1 {{(pid=127033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:59:22.304364 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG dbcounter [-] [127033] Writing DB stats nova_api:SELECT=15,nova_api:DELETE=1 {{(pid=127033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:59:22.308967 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-244d184b-c34f-4592-820a-c4550dbd77aa tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:22.309461 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-244d184b-c34f-4592-820a-c4550dbd77aa tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] [instance: b510dc8e-9a8c-40dd-9efe-c3f6d747c689] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:22.319675 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-244d184b-c34f-4592-820a-c4550dbd77aa tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:22.320231 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-244d184b-c34f-4592-820a-c4550dbd77aa tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:22.320672 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-244d184b-c34f-4592-820a-c4550dbd77aa tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:22.321366 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-244d184b-c34f-4592-820a-c4550dbd77aa tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:22.321826 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-244d184b-c34f-4592-820a-c4550dbd77aa tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:22.322256 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-244d184b-c34f-4592-820a-c4550dbd77aa tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:22.347324 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-244d184b-c34f-4592-820a-c4550dbd77aa tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] 10.222.0.52 "GET /compute/v2.1/servers/b510dc8e-9a8c-40dd-9efe-c3f6d747c689/ips" status: 200 len: 148 microversion: 2.1 time: 0.045275 Oct 28 09:59:22.347938 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 472/961] 10.222.0.52 () {58 vars in 1248 bytes} [Fri Oct 28 09:59:22 2022] GET /compute/v2.1/servers/b510dc8e-9a8c-40dd-9efe-c3f6d747c689/ips => generated 148 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:59:23.674863 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG dbcounter [-] [127032] Writing DB stats nova_cell0:SELECT=4 {{(pid=127032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:59:23.675634 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG dbcounter [-] [127032] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=127032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:59:23.680082 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-9f715b00-df84-4e9c-b299-498684fe8d67 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e253e64b-5486-40eb-a798-dbe02dea3c95"}} {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:59:23.682412 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-9f715b00-df84-4e9c-b299-498684fe8d67 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] [instance: b510dc8e-9a8c-40dd-9efe-c3f6d747c689] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:23.690696 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-9f715b00-df84-4e9c-b299-498684fe8d67 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:23.691181 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-9f715b00-df84-4e9c-b299-498684fe8d67 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:23.691617 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-9f715b00-df84-4e9c-b299-498684fe8d67 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:23.692343 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-9f715b00-df84-4e9c-b299-498684fe8d67 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:23.692801 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-9f715b00-df84-4e9c-b299-498684fe8d67 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:23.693227 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-9f715b00-df84-4e9c-b299-498684fe8d67 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:23.800223 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-dad1d7de-6de8-4854-803d-45f126f169fd tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1396130259", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-2097717922", "security_groups": [{"name": "tempest-secgroup-smoke-582510588"}], "networks": [{"uuid": "fcc75046-8c07-4b89-a65d-5237ad59dd29"}], "block_device_mapping_v2": [{"uuid": "ce1c8d8e-fbc4-480d-a7ea-4e6a3df9d78c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:59:23.927040 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.network.neutron [None req-dad1d7de-6de8-4854-803d-45f126f169fd tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] validate_networks() for [('fcc75046-8c07-4b89-a65d-5237ad59dd29', None, None, None, None, None)] {{(pid=127033) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 09:59:24.042168 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-9f715b00-df84-4e9c-b299-498684fe8d67 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] 10.222.0.52 "POST /compute/v2.1/servers/b510dc8e-9a8c-40dd-9efe-c3f6d747c689/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.368293 Oct 28 09:59:24.042842 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 490/962] 10.222.0.52 () {60 vars in 1323 bytes} [Fri Oct 28 09:59:23 2022] POST /compute/v2.1/servers/b510dc8e-9a8c-40dd-9efe-c3f6d747c689/os-volume_attachments => generated 194 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:59:24.314754 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.virt.hardware [None req-dad1d7de-6de8-4854-803d-45f126f169fd tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Flavor limits 0:0:0 {{(pid=127033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 09:59:24.315794 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.virt.hardware [None req-dad1d7de-6de8-4854-803d-45f126f169fd tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Image limits 0:0:0 {{(pid=127033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 09:59:24.316381 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.virt.hardware [None req-dad1d7de-6de8-4854-803d-45f126f169fd tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Flavor pref 0:0:0 {{(pid=127033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 09:59:24.316860 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.virt.hardware [None req-dad1d7de-6de8-4854-803d-45f126f169fd tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Image pref 0:0:0 {{(pid=127033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 09:59:24.317460 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.virt.hardware [None req-dad1d7de-6de8-4854-803d-45f126f169fd tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 09:59:24.326239 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-dad1d7de-6de8-4854-803d-45f126f169fd tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:24.326723 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-dad1d7de-6de8-4854-803d-45f126f169fd tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:24.327186 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-dad1d7de-6de8-4854-803d-45f126f169fd tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:24.327957 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-dad1d7de-6de8-4854-803d-45f126f169fd tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:24.328420 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-dad1d7de-6de8-4854-803d-45f126f169fd tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:24.328849 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-dad1d7de-6de8-4854-803d-45f126f169fd tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:24.346087 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.quota [None req-dad1d7de-6de8-4854-803d-45f126f169fd tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Getting quotas for project 3ce53f0f4dec4042a2cd5a3213b82f5f. Resources: {'cores', 'ram', 'instances'} {{(pid=127033) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 09:59:24.350243 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.quota [None req-dad1d7de-6de8-4854-803d-45f126f169fd tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Getting quotas for user 5b9bb73c501c444ca98c8af9d7b4c7bd and project 3ce53f0f4dec4042a2cd5a3213b82f5f. Resources: {'cores', 'ram', 'instances'} {{(pid=127033) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 09:59:24.409626 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-dad1d7de-6de8-4854-803d-45f126f169fd tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Going to run 1 instances... {{(pid=127033) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 09:59:24.412528 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-dad1d7de-6de8-4854-803d-45f126f169fd tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] [instance: d9b6a132-b028-452c-8b88-fc7b27ef8c0f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ce1c8d8e-fbc4-480d-a7ea-4e6a3df9d78c',volume_size=None,volume_type=None)] {{(pid=127033) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 09:59:24.539924 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-dad1d7de-6de8-4854-803d-45f126f169fd tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.743587 Oct 28 09:59:24.540581 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 473/963] 10.222.0.52 () {60 vars in 1147 bytes} [Fri Oct 28 09:59:23 2022] POST /compute/v2.1/servers => generated 405 bytes in 745 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 28 09:59:24.553323 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-a73e1962-318c-43a4-9db0-72ef063c8bd9 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:24.554614 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-a73e1962-318c-43a4-9db0-72ef063c8bd9 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] [instance: d9b6a132-b028-452c-8b88-fc7b27ef8c0f] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:24.610240 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-a73e1962-318c-43a4-9db0-72ef063c8bd9 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9bb73c501c444ca98c8af9d7b4c7bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce53f0f4dec4042a2cd5a3213b82f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:24.617698 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-a73e1962-318c-43a4-9db0-72ef063c8bd9 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] 10.222.0.52 "GET /compute/v2.1/servers/d9b6a132-b028-452c-8b88-fc7b27ef8c0f" status: 200 len: 1089 microversion: 2.1 time: 0.069593 Oct 28 09:59:24.618463 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 491/964] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:59:24 2022] GET /compute/v2.1/servers/d9b6a132-b028-452c-8b88-fc7b27ef8c0f => generated 1089 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:59:25.641237 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-56a6c1f6-3b4d-4261-a3ac-da5f07e19bc5 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:25.641856 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-56a6c1f6-3b4d-4261-a3ac-da5f07e19bc5 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] [instance: d9b6a132-b028-452c-8b88-fc7b27ef8c0f] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:25.649251 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-56a6c1f6-3b4d-4261-a3ac-da5f07e19bc5 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:25.649747 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-56a6c1f6-3b4d-4261-a3ac-da5f07e19bc5 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:25.650179 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-56a6c1f6-3b4d-4261-a3ac-da5f07e19bc5 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:25.650880 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-56a6c1f6-3b4d-4261-a3ac-da5f07e19bc5 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:25.651338 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-56a6c1f6-3b4d-4261-a3ac-da5f07e19bc5 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:25.651777 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-56a6c1f6-3b4d-4261-a3ac-da5f07e19bc5 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:25.714176 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-56a6c1f6-3b4d-4261-a3ac-da5f07e19bc5 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9bb73c501c444ca98c8af9d7b4c7bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce53f0f4dec4042a2cd5a3213b82f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:25.721936 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-56a6c1f6-3b4d-4261-a3ac-da5f07e19bc5 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] 10.222.0.52 "GET /compute/v2.1/servers/d9b6a132-b028-452c-8b88-fc7b27ef8c0f" status: 200 len: 1187 microversion: 2.1 time: 0.084838 Oct 28 09:59:25.722496 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 474/965] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:59:25 2022] GET /compute/v2.1/servers/d9b6a132-b028-452c-8b88-fc7b27ef8c0f => generated 1187 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:59:26.421061 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-46b55053-36d9-4626-821b-b993b9d7d5c1 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:26.421683 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-46b55053-36d9-4626-821b-b993b9d7d5c1 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] [instance: b510dc8e-9a8c-40dd-9efe-c3f6d747c689] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:26.429363 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-46b55053-36d9-4626-821b-b993b9d7d5c1 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:26.430010 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-46b55053-36d9-4626-821b-b993b9d7d5c1 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:26.430265 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-46b55053-36d9-4626-821b-b993b9d7d5c1 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:26.431246 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-46b55053-36d9-4626-821b-b993b9d7d5c1 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:26.431817 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-46b55053-36d9-4626-821b-b993b9d7d5c1 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:26.432290 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-46b55053-36d9-4626-821b-b993b9d7d5c1 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:26.525470 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.objects.instance [None req-46b55053-36d9-4626-821b-b993b9d7d5c1 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lazy-loading 'services' on Instance uuid b510dc8e-9a8c-40dd-9efe-c3f6d747c689 {{(pid=127032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:59:26.607875 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-46b55053-36d9-4626-821b-b993b9d7d5c1 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] 10.222.0.52 "DELETE /compute/v2.1/servers/b510dc8e-9a8c-40dd-9efe-c3f6d747c689/os-volume_attachments/e253e64b-5486-40eb-a798-dbe02dea3c95" status: 202 len: 0 microversion: 2.1 time: 0.191198 Oct 28 09:59:26.608470 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 492/966] 10.222.0.52 () {58 vars in 1416 bytes} [Fri Oct 28 09:59:26 2022] DELETE /compute/v2.1/servers/b510dc8e-9a8c-40dd-9efe-c3f6d747c689/os-volume_attachments/e253e64b-5486-40eb-a798-dbe02dea3c95 => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:59:26.618236 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-d32d802b-54b9-495b-b2e2-bf8b7bb18439 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:26.620977 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-d32d802b-54b9-495b-b2e2-bf8b7bb18439 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] [instance: b510dc8e-9a8c-40dd-9efe-c3f6d747c689] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:26.632485 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-d32d802b-54b9-495b-b2e2-bf8b7bb18439 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:26.632947 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-d32d802b-54b9-495b-b2e2-bf8b7bb18439 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:26.633383 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-d32d802b-54b9-495b-b2e2-bf8b7bb18439 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:26.634089 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-d32d802b-54b9-495b-b2e2-bf8b7bb18439 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:26.634543 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-d32d802b-54b9-495b-b2e2-bf8b7bb18439 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:26.634963 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-d32d802b-54b9-495b-b2e2-bf8b7bb18439 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:26.669029 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-d32d802b-54b9-495b-b2e2-bf8b7bb18439 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] 10.222.0.52 "GET /compute/v2.1/servers/b510dc8e-9a8c-40dd-9efe-c3f6d747c689/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055363 Oct 28 09:59:26.671425 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 475/967] 10.222.0.52 () {58 vars in 1302 bytes} [Fri Oct 28 09:59:26 2022] GET /compute/v2.1/servers/b510dc8e-9a8c-40dd-9efe-c3f6d747c689/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:59:26.746397 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-5c115bec-442b-4982-8257-5f02ffae91b4 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:26.747634 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-5c115bec-442b-4982-8257-5f02ffae91b4 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] [instance: d9b6a132-b028-452c-8b88-fc7b27ef8c0f] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:26.758030 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-5c115bec-442b-4982-8257-5f02ffae91b4 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:26.758767 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-5c115bec-442b-4982-8257-5f02ffae91b4 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:26.759641 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-5c115bec-442b-4982-8257-5f02ffae91b4 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:26.760595 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-5c115bec-442b-4982-8257-5f02ffae91b4 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:26.761247 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-5c115bec-442b-4982-8257-5f02ffae91b4 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:26.761896 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-5c115bec-442b-4982-8257-5f02ffae91b4 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:26.780099 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 09:59:26.780305 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Fri Oct 28 09:59:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d9b6a132-b028-452c-8b88-fc7b27ef8c0f (ip 10.222.0.52) !!! Oct 28 09:59:26.913355 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-5c115bec-442b-4982-8257-5f02ffae91b4 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9bb73c501c444ca98c8af9d7b4c7bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce53f0f4dec4042a2cd5a3213b82f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:26.921361 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-5c115bec-442b-4982-8257-5f02ffae91b4 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] 10.222.0.52 "GET /compute/v2.1/servers/d9b6a132-b028-452c-8b88-fc7b27ef8c0f" status: 200 len: 1260 microversion: 2.1 time: 0.180293 Oct 28 09:59:26.922118 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 493/968] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:59:26 2022] GET /compute/v2.1/servers/d9b6a132-b028-452c-8b88-fc7b27ef8c0f => generated 1260 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:59:27.429918 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [req-f07223c6-2592-4b6c-9b14-1e52a3d11df9 req-d45c3d8f-ca9e-4fda-90a1-b056c5eaa6cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9b6a132-b028-452c-8b88-fc7b27ef8c0f", "tag": "68c29671-d76d-40cf-af9c-23b8f386cff8"}]} {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:59:27.439543 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-f07223c6-2592-4b6c-9b14-1e52a3d11df9 req-d45c3d8f-ca9e-4fda-90a1-b056c5eaa6cc service nova] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:27.440151 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-f07223c6-2592-4b6c-9b14-1e52a3d11df9 req-d45c3d8f-ca9e-4fda-90a1-b056c5eaa6cc service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:27.440653 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-f07223c6-2592-4b6c-9b14-1e52a3d11df9 req-d45c3d8f-ca9e-4fda-90a1-b056c5eaa6cc service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:27.452343 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.compute.server_external_events [req-f07223c6-2592-4b6c-9b14-1e52a3d11df9 req-d45c3d8f-ca9e-4fda-90a1-b056c5eaa6cc service nova] Creating event network-changed:68c29671-d76d-40cf-af9c-23b8f386cff8 for instance d9b6a132-b028-452c-8b88-fc7b27ef8c0f on hv-cinder-zed-3 Oct 28 09:59:27.458170 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [req-f07223c6-2592-4b6c-9b14-1e52a3d11df9 req-d45c3d8f-ca9e-4fda-90a1-b056c5eaa6cc service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032042 Oct 28 09:59:27.459216 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 476/969] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Oct 28 09:59:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 09:59:27.682755 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-885a5672-27c0-4018-8f0d-8af4b0ce6aed tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:27.685063 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-885a5672-27c0-4018-8f0d-8af4b0ce6aed tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] [instance: b510dc8e-9a8c-40dd-9efe-c3f6d747c689] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:27.692093 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-885a5672-27c0-4018-8f0d-8af4b0ce6aed tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:27.692587 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-885a5672-27c0-4018-8f0d-8af4b0ce6aed tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:27.693032 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-885a5672-27c0-4018-8f0d-8af4b0ce6aed tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:27.693729 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-885a5672-27c0-4018-8f0d-8af4b0ce6aed tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:27.694184 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-885a5672-27c0-4018-8f0d-8af4b0ce6aed tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:27.694608 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-885a5672-27c0-4018-8f0d-8af4b0ce6aed tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:27.727156 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-885a5672-27c0-4018-8f0d-8af4b0ce6aed tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] 10.222.0.52 "GET /compute/v2.1/servers/b510dc8e-9a8c-40dd-9efe-c3f6d747c689/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048413 Oct 28 09:59:27.727863 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 494/970] 10.222.0.52 () {58 vars in 1302 bytes} [Fri Oct 28 09:59:27 2022] GET /compute/v2.1/servers/b510dc8e-9a8c-40dd-9efe-c3f6d747c689/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 09:59:27.794791 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-406d7f5c-7773-413d-9d52-c753fae672c8 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:27.795366 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-406d7f5c-7773-413d-9d52-c753fae672c8 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] [instance: b510dc8e-9a8c-40dd-9efe-c3f6d747c689] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:27.801766 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-406d7f5c-7773-413d-9d52-c753fae672c8 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:27.802257 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-406d7f5c-7773-413d-9d52-c753fae672c8 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:27.802695 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-406d7f5c-7773-413d-9d52-c753fae672c8 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:27.803395 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-406d7f5c-7773-413d-9d52-c753fae672c8 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:27.803885 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-406d7f5c-7773-413d-9d52-c753fae672c8 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:27.804321 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-406d7f5c-7773-413d-9d52-c753fae672c8 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:27.830040 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-406d7f5c-7773-413d-9d52-c753fae672c8 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] [instance: b510dc8e-9a8c-40dd-9efe-c3f6d747c689] Going to try to terminate instance {{(pid=127033) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 09:59:27.910527 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-406d7f5c-7773-413d-9d52-c753fae672c8 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] 10.222.0.52 "DELETE /compute/v2.1/servers/b510dc8e-9a8c-40dd-9efe-c3f6d747c689" status: 204 len: 0 microversion: 2.1 time: 0.120113 Oct 28 09:59:27.911666 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 477/971] 10.222.0.52 () {58 vars in 1239 bytes} [Fri Oct 28 09:59:27 2022] DELETE /compute/v2.1/servers/b510dc8e-9a8c-40dd-9efe-c3f6d747c689 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 09:59:27.919887 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-a2c61453-8a1a-472f-b993-889a624b5f5b tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:27.920766 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-a2c61453-8a1a-472f-b993-889a624b5f5b tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] [instance: b510dc8e-9a8c-40dd-9efe-c3f6d747c689] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:27.926678 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-a2c61453-8a1a-472f-b993-889a624b5f5b tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:27.927165 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-a2c61453-8a1a-472f-b993-889a624b5f5b tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:27.927603 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-a2c61453-8a1a-472f-b993-889a624b5f5b tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:27.928356 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-a2c61453-8a1a-472f-b993-889a624b5f5b tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:27.928815 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-a2c61453-8a1a-472f-b993-889a624b5f5b tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:27.929240 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-a2c61453-8a1a-472f-b993-889a624b5f5b tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:27.946835 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-7b741be6-efbd-4c54-9333-ae34621aa019 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:27.947847 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-7b741be6-efbd-4c54-9333-ae34621aa019 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] [instance: d9b6a132-b028-452c-8b88-fc7b27ef8c0f] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:27.955087 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-7b741be6-efbd-4c54-9333-ae34621aa019 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:27.955806 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-7b741be6-efbd-4c54-9333-ae34621aa019 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:27.957006 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-7b741be6-efbd-4c54-9333-ae34621aa019 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:27.957781 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-7b741be6-efbd-4c54-9333-ae34621aa019 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:27.958421 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-7b741be6-efbd-4c54-9333-ae34621aa019 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:27.958809 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-7b741be6-efbd-4c54-9333-ae34621aa019 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:28.111510 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-a2c61453-8a1a-472f-b993-889a624b5f5b tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38ce75423b5412d90c1158396978b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e60d7c624e49e1bb43188ae9d7dd2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:28.119711 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-a2c61453-8a1a-472f-b993-889a624b5f5b tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] 10.222.0.52 "GET /compute/v2.1/servers/b510dc8e-9a8c-40dd-9efe-c3f6d747c689" status: 200 len: 1678 microversion: 2.1 time: 0.203702 Oct 28 09:59:28.120316 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 495/972] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:59:27 2022] GET /compute/v2.1/servers/b510dc8e-9a8c-40dd-9efe-c3f6d747c689 => generated 1678 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:59:28.140332 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-7b741be6-efbd-4c54-9333-ae34621aa019 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9bb73c501c444ca98c8af9d7b4c7bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce53f0f4dec4042a2cd5a3213b82f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:28.148616 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-7b741be6-efbd-4c54-9333-ae34621aa019 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] 10.222.0.52 "GET /compute/v2.1/servers/d9b6a132-b028-452c-8b88-fc7b27ef8c0f" status: 200 len: 1260 microversion: 2.1 time: 0.207059 Oct 28 09:59:28.149177 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 478/973] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:59:27 2022] GET /compute/v2.1/servers/d9b6a132-b028-452c-8b88-fc7b27ef8c0f => generated 1260 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:59:29.143192 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-e9934d19-2a66-4a54-848a-4e9c81f3a189 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:29.144426 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-e9934d19-2a66-4a54-848a-4e9c81f3a189 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] [instance: b510dc8e-9a8c-40dd-9efe-c3f6d747c689] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:29.151037 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-e9934d19-2a66-4a54-848a-4e9c81f3a189 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:29.151492 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-e9934d19-2a66-4a54-848a-4e9c81f3a189 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:29.151960 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-e9934d19-2a66-4a54-848a-4e9c81f3a189 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:29.152685 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-e9934d19-2a66-4a54-848a-4e9c81f3a189 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:29.153144 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-e9934d19-2a66-4a54-848a-4e9c81f3a189 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:29.153568 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-e9934d19-2a66-4a54-848a-4e9c81f3a189 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:29.170316 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-86cdaf88-0380-4113-835a-2ee5268786a8 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:29.171086 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-86cdaf88-0380-4113-835a-2ee5268786a8 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] [instance: d9b6a132-b028-452c-8b88-fc7b27ef8c0f] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:29.178082 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-86cdaf88-0380-4113-835a-2ee5268786a8 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:29.178571 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-86cdaf88-0380-4113-835a-2ee5268786a8 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:29.179007 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-86cdaf88-0380-4113-835a-2ee5268786a8 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:29.179701 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-86cdaf88-0380-4113-835a-2ee5268786a8 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:29.180184 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-86cdaf88-0380-4113-835a-2ee5268786a8 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:29.180643 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-86cdaf88-0380-4113-835a-2ee5268786a8 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:29.352683 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-e9934d19-2a66-4a54-848a-4e9c81f3a189 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38ce75423b5412d90c1158396978b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e60d7c624e49e1bb43188ae9d7dd2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:29.360878 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-e9934d19-2a66-4a54-848a-4e9c81f3a189 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] 10.222.0.52 "GET /compute/v2.1/servers/b510dc8e-9a8c-40dd-9efe-c3f6d747c689" status: 200 len: 1678 microversion: 2.1 time: 0.221617 Oct 28 09:59:29.361464 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 496/974] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:59:29 2022] GET /compute/v2.1/servers/b510dc8e-9a8c-40dd-9efe-c3f6d747c689 => generated 1678 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:59:29.361617 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-86cdaf88-0380-4113-835a-2ee5268786a8 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9bb73c501c444ca98c8af9d7b4c7bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce53f0f4dec4042a2cd5a3213b82f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:29.370302 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-86cdaf88-0380-4113-835a-2ee5268786a8 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] 10.222.0.52 "GET /compute/v2.1/servers/d9b6a132-b028-452c-8b88-fc7b27ef8c0f" status: 200 len: 1260 microversion: 2.1 time: 0.203776 Oct 28 09:59:29.370858 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 479/975] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:59:29 2022] GET /compute/v2.1/servers/d9b6a132-b028-452c-8b88-fc7b27ef8c0f => generated 1260 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:59:30.385516 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-6481cd6b-65a0-445f-8108-c9a9e2e9ed25 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:30.386063 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-6481cd6b-65a0-445f-8108-c9a9e2e9ed25 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] [instance: b510dc8e-9a8c-40dd-9efe-c3f6d747c689] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:30.392489 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-6481cd6b-65a0-445f-8108-c9a9e2e9ed25 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:30.392975 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-6481cd6b-65a0-445f-8108-c9a9e2e9ed25 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:30.393345 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-06c92543-84b7-48e8-ba85-f2c5a2402664 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:30.393810 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-6481cd6b-65a0-445f-8108-c9a9e2e9ed25 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:30.393995 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-06c92543-84b7-48e8-ba85-f2c5a2402664 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] [instance: d9b6a132-b028-452c-8b88-fc7b27ef8c0f] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:30.394114 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-6481cd6b-65a0-445f-8108-c9a9e2e9ed25 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:30.394493 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-6481cd6b-65a0-445f-8108-c9a9e2e9ed25 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:30.394904 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-6481cd6b-65a0-445f-8108-c9a9e2e9ed25 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:30.400361 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-06c92543-84b7-48e8-ba85-f2c5a2402664 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:30.400847 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-06c92543-84b7-48e8-ba85-f2c5a2402664 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:30.401282 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-06c92543-84b7-48e8-ba85-f2c5a2402664 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:30.401975 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-06c92543-84b7-48e8-ba85-f2c5a2402664 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:30.402435 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-06c92543-84b7-48e8-ba85-f2c5a2402664 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:30.402943 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-06c92543-84b7-48e8-ba85-f2c5a2402664 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:30.591912 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-6481cd6b-65a0-445f-8108-c9a9e2e9ed25 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38ce75423b5412d90c1158396978b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e60d7c624e49e1bb43188ae9d7dd2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:30.599595 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-6481cd6b-65a0-445f-8108-c9a9e2e9ed25 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] 10.222.0.52 "GET /compute/v2.1/servers/b510dc8e-9a8c-40dd-9efe-c3f6d747c689" status: 200 len: 1678 microversion: 2.1 time: 0.218004 Oct 28 09:59:30.600201 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 497/976] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:59:30 2022] GET /compute/v2.1/servers/b510dc8e-9a8c-40dd-9efe-c3f6d747c689 => generated 1678 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:59:30.600639 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-06c92543-84b7-48e8-ba85-f2c5a2402664 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9bb73c501c444ca98c8af9d7b4c7bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce53f0f4dec4042a2cd5a3213b82f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:30.608563 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-06c92543-84b7-48e8-ba85-f2c5a2402664 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] 10.222.0.52 "GET /compute/v2.1/servers/d9b6a132-b028-452c-8b88-fc7b27ef8c0f" status: 200 len: 1260 microversion: 2.1 time: 0.219108 Oct 28 09:59:30.609127 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 480/977] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:59:30 2022] GET /compute/v2.1/servers/d9b6a132-b028-452c-8b88-fc7b27ef8c0f => generated 1260 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:59:31.622441 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-8691a8ca-9976-4190-beb6-2971790e367a tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:31.623035 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-8691a8ca-9976-4190-beb6-2971790e367a tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] [instance: b510dc8e-9a8c-40dd-9efe-c3f6d747c689] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:31.631243 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-8691a8ca-9976-4190-beb6-2971790e367a tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:31.632023 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-8691a8ca-9976-4190-beb6-2971790e367a tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:31.632779 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-8691a8ca-9976-4190-beb6-2971790e367a tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:31.633648 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-8691a8ca-9976-4190-beb6-2971790e367a tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:31.634345 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-8691a8ca-9976-4190-beb6-2971790e367a tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:31.634922 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-8691a8ca-9976-4190-beb6-2971790e367a tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:31.637707 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-8b571643-d973-4c05-b48b-d68f2e11bc1f tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:31.639182 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-8b571643-d973-4c05-b48b-d68f2e11bc1f tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] [instance: d9b6a132-b028-452c-8b88-fc7b27ef8c0f] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:31.647091 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-8b571643-d973-4c05-b48b-d68f2e11bc1f tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:31.647572 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-8b571643-d973-4c05-b48b-d68f2e11bc1f tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:31.648235 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-8b571643-d973-4c05-b48b-d68f2e11bc1f tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:31.649115 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-8b571643-d973-4c05-b48b-d68f2e11bc1f tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:31.649741 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-8b571643-d973-4c05-b48b-d68f2e11bc1f tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:31.650318 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-8b571643-d973-4c05-b48b-d68f2e11bc1f tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:31.846774 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-8691a8ca-9976-4190-beb6-2971790e367a tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38ce75423b5412d90c1158396978b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e60d7c624e49e1bb43188ae9d7dd2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:31.850340 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-8b571643-d973-4c05-b48b-d68f2e11bc1f tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9bb73c501c444ca98c8af9d7b4c7bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce53f0f4dec4042a2cd5a3213b82f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:31.854450 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-8691a8ca-9976-4190-beb6-2971790e367a tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] 10.222.0.52 "GET /compute/v2.1/servers/b510dc8e-9a8c-40dd-9efe-c3f6d747c689" status: 200 len: 1678 microversion: 2.1 time: 0.235852 Oct 28 09:59:31.855057 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 498/978] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:59:31 2022] GET /compute/v2.1/servers/b510dc8e-9a8c-40dd-9efe-c3f6d747c689 => generated 1678 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:59:31.858270 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-8b571643-d973-4c05-b48b-d68f2e11bc1f tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] 10.222.0.52 "GET /compute/v2.1/servers/d9b6a132-b028-452c-8b88-fc7b27ef8c0f" status: 200 len: 1260 microversion: 2.1 time: 0.227591 Oct 28 09:59:31.858835 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 481/979] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:59:31 2022] GET /compute/v2.1/servers/d9b6a132-b028-452c-8b88-fc7b27ef8c0f => generated 1260 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:59:32.153998 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [req-6e83ee6c-5192-4786-88a9-4a4b23c30497 req-d9bf328c-a971-4e47-a27d-dbf98b893c59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9b6a132-b028-452c-8b88-fc7b27ef8c0f", "name": "network-vif-plugged", "status": "completed", "tag": "68c29671-d76d-40cf-af9c-23b8f386cff8"}]} {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:59:32.164737 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-6e83ee6c-5192-4786-88a9-4a4b23c30497 req-d9bf328c-a971-4e47-a27d-dbf98b893c59 service nova] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:32.165351 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-6e83ee6c-5192-4786-88a9-4a4b23c30497 req-d9bf328c-a971-4e47-a27d-dbf98b893c59 service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:32.165869 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-6e83ee6c-5192-4786-88a9-4a4b23c30497 req-d9bf328c-a971-4e47-a27d-dbf98b893c59 service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:32.178834 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.compute.server_external_events [req-6e83ee6c-5192-4786-88a9-4a4b23c30497 req-d9bf328c-a971-4e47-a27d-dbf98b893c59 service nova] Creating event network-vif-plugged:68c29671-d76d-40cf-af9c-23b8f386cff8 for instance d9b6a132-b028-452c-8b88-fc7b27ef8c0f on hv-cinder-zed-3 Oct 28 09:59:32.184099 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [req-6e83ee6c-5192-4786-88a9-4a4b23c30497 req-d9bf328c-a971-4e47-a27d-dbf98b893c59 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033980 Oct 28 09:59:32.185138 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 499/980] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Oct 28 09:59:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:59:32.878926 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-480cb2c4-474d-42a4-8d7a-3fb8e11604b0 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:32.879514 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-480cb2c4-474d-42a4-8d7a-3fb8e11604b0 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] [instance: b510dc8e-9a8c-40dd-9efe-c3f6d747c689] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:32.882480 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-a74ff2ba-88ce-4f83-8ce6-131ecc453d0b tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:32.883451 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-a74ff2ba-88ce-4f83-8ce6-131ecc453d0b tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] [instance: d9b6a132-b028-452c-8b88-fc7b27ef8c0f] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:32.886266 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-480cb2c4-474d-42a4-8d7a-3fb8e11604b0 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:32.886770 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-480cb2c4-474d-42a4-8d7a-3fb8e11604b0 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:32.887211 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-480cb2c4-474d-42a4-8d7a-3fb8e11604b0 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:32.887943 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-480cb2c4-474d-42a4-8d7a-3fb8e11604b0 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:32.888409 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-480cb2c4-474d-42a4-8d7a-3fb8e11604b0 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:32.889045 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-480cb2c4-474d-42a4-8d7a-3fb8e11604b0 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:32.890039 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-a74ff2ba-88ce-4f83-8ce6-131ecc453d0b tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:32.890536 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-a74ff2ba-88ce-4f83-8ce6-131ecc453d0b tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:32.890965 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-a74ff2ba-88ce-4f83-8ce6-131ecc453d0b tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:32.891909 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-a74ff2ba-88ce-4f83-8ce6-131ecc453d0b tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:32.892368 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-a74ff2ba-88ce-4f83-8ce6-131ecc453d0b tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:32.892794 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-a74ff2ba-88ce-4f83-8ce6-131ecc453d0b tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:33.099150 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-a74ff2ba-88ce-4f83-8ce6-131ecc453d0b tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9bb73c501c444ca98c8af9d7b4c7bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce53f0f4dec4042a2cd5a3213b82f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:33.101905 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-480cb2c4-474d-42a4-8d7a-3fb8e11604b0 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38ce75423b5412d90c1158396978b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e60d7c624e49e1bb43188ae9d7dd2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:33.107475 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-a74ff2ba-88ce-4f83-8ce6-131ecc453d0b tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] 10.222.0.52 "GET /compute/v2.1/servers/d9b6a132-b028-452c-8b88-fc7b27ef8c0f" status: 200 len: 1260 microversion: 2.1 time: 0.229631 Oct 28 09:59:33.108692 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 500/981] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:59:32 2022] GET /compute/v2.1/servers/d9b6a132-b028-452c-8b88-fc7b27ef8c0f => generated 1260 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:59:33.121890 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-480cb2c4-474d-42a4-8d7a-3fb8e11604b0 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] 10.222.0.52 "GET /compute/v2.1/servers/b510dc8e-9a8c-40dd-9efe-c3f6d747c689" status: 200 len: 1678 microversion: 2.1 time: 0.247223 Oct 28 09:59:33.123810 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 482/982] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:59:32 2022] GET /compute/v2.1/servers/b510dc8e-9a8c-40dd-9efe-c3f6d747c689 => generated 1678 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:59:33.348565 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [req-9e2d198f-9acc-44cd-b1fa-204f97a547d8 req-c3d70f96-5b22-43e9-9726-d160a91cebdb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b510dc8e-9a8c-40dd-9efe-c3f6d747c689", "name": "network-vif-deleted", "tag": "55670a32-4880-4759-b844-705473cc2214"}]} {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:59:33.357808 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-9e2d198f-9acc-44cd-b1fa-204f97a547d8 req-c3d70f96-5b22-43e9-9726-d160a91cebdb service nova] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:33.358291 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-9e2d198f-9acc-44cd-b1fa-204f97a547d8 req-c3d70f96-5b22-43e9-9726-d160a91cebdb service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:33.358728 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-9e2d198f-9acc-44cd-b1fa-204f97a547d8 req-c3d70f96-5b22-43e9-9726-d160a91cebdb service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:33.370761 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.compute.server_external_events [req-9e2d198f-9acc-44cd-b1fa-204f97a547d8 req-c3d70f96-5b22-43e9-9726-d160a91cebdb service nova] Creating event network-vif-deleted:55670a32-4880-4759-b844-705473cc2214 for instance b510dc8e-9a8c-40dd-9efe-c3f6d747c689 on hv-cinder-zed-3 Oct 28 09:59:33.375601 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [req-9e2d198f-9acc-44cd-b1fa-204f97a547d8 req-c3d70f96-5b22-43e9-9726-d160a91cebdb service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030831 Oct 28 09:59:33.376502 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 501/983] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Oct 28 09:59:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:59:34.132024 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-c0f7193d-b3c4-483a-8688-423773dcbe81 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:34.132024 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-c0f7193d-b3c4-483a-8688-423773dcbe81 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] [instance: d9b6a132-b028-452c-8b88-fc7b27ef8c0f] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:34.138623 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-c0f7193d-b3c4-483a-8688-423773dcbe81 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:34.139173 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-c0f7193d-b3c4-483a-8688-423773dcbe81 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:34.139616 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-c0f7193d-b3c4-483a-8688-423773dcbe81 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:34.140552 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-c0f7193d-b3c4-483a-8688-423773dcbe81 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:34.141011 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-c0f7193d-b3c4-483a-8688-423773dcbe81 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:34.141475 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-c0f7193d-b3c4-483a-8688-423773dcbe81 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:34.150033 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-3f7c382c-be19-4a9c-8c52-12aa54695918 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:34.150738 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-3f7c382c-be19-4a9c-8c52-12aa54695918 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] [instance: b510dc8e-9a8c-40dd-9efe-c3f6d747c689] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:34.157501 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-3f7c382c-be19-4a9c-8c52-12aa54695918 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:34.158213 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-3f7c382c-be19-4a9c-8c52-12aa54695918 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:34.158840 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-3f7c382c-be19-4a9c-8c52-12aa54695918 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:34.160142 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-3f7c382c-be19-4a9c-8c52-12aa54695918 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:34.160757 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-3f7c382c-be19-4a9c-8c52-12aa54695918 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:34.161332 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-3f7c382c-be19-4a9c-8c52-12aa54695918 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:34.196518 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-3f7c382c-be19-4a9c-8c52-12aa54695918 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:34.200015 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-3f7c382c-be19-4a9c-8c52-12aa54695918 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:34.200015 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-3f7c382c-be19-4a9c-8c52-12aa54695918 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:34.200015 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.objects.instance [None req-3f7c382c-be19-4a9c-8c52-12aa54695918 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lazy-loading 'fault' on Instance uuid b510dc8e-9a8c-40dd-9efe-c3f6d747c689 {{(pid=127032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:59:34.250773 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-3f7c382c-be19-4a9c-8c52-12aa54695918 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38ce75423b5412d90c1158396978b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e60d7c624e49e1bb43188ae9d7dd2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:34.260219 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-3f7c382c-be19-4a9c-8c52-12aa54695918 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] 10.222.0.52 "GET /compute/v2.1/servers/b510dc8e-9a8c-40dd-9efe-c3f6d747c689" status: 200 len: 1330 microversion: 2.1 time: 0.116718 Oct 28 09:59:34.261609 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 502/984] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:59:34 2022] GET /compute/v2.1/servers/b510dc8e-9a8c-40dd-9efe-c3f6d747c689 => generated 1330 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:59:34.317471 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-c0f7193d-b3c4-483a-8688-423773dcbe81 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9bb73c501c444ca98c8af9d7b4c7bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce53f0f4dec4042a2cd5a3213b82f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:34.326357 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-c0f7193d-b3c4-483a-8688-423773dcbe81 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] 10.222.0.52 "GET /compute/v2.1/servers/d9b6a132-b028-452c-8b88-fc7b27ef8c0f" status: 200 len: 1444 microversion: 2.1 time: 0.199327 Oct 28 09:59:34.326955 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 483/985] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:59:34 2022] GET /compute/v2.1/servers/d9b6a132-b028-452c-8b88-fc7b27ef8c0f => generated 1444 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:59:34.350066 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-93b71c5f-fd85-47dd-8e07-5cd7a5123f5d tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:34.350794 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-93b71c5f-fd85-47dd-8e07-5cd7a5123f5d tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] [instance: d9b6a132-b028-452c-8b88-fc7b27ef8c0f] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:34.357085 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-93b71c5f-fd85-47dd-8e07-5cd7a5123f5d tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:34.357510 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-93b71c5f-fd85-47dd-8e07-5cd7a5123f5d tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:34.358130 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-93b71c5f-fd85-47dd-8e07-5cd7a5123f5d tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:34.358629 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-93b71c5f-fd85-47dd-8e07-5cd7a5123f5d tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:34.359082 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-93b71c5f-fd85-47dd-8e07-5cd7a5123f5d tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:34.359507 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-93b71c5f-fd85-47dd-8e07-5cd7a5123f5d tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:34.615698 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG dbcounter [-] [127032] Writing DB stats nova_cell0:SELECT=2 {{(pid=127032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:59:34.693812 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-93b71c5f-fd85-47dd-8e07-5cd7a5123f5d tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9bb73c501c444ca98c8af9d7b4c7bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce53f0f4dec4042a2cd5a3213b82f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:34.701634 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-93b71c5f-fd85-47dd-8e07-5cd7a5123f5d tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] 10.222.0.52 "GET /compute/v2.1/servers/d9b6a132-b028-452c-8b88-fc7b27ef8c0f" status: 200 len: 1444 microversion: 2.1 time: 0.356069 Oct 28 09:59:34.702342 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 503/986] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:59:34 2022] GET /compute/v2.1/servers/d9b6a132-b028-452c-8b88-fc7b27ef8c0f => generated 1444 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:59:35.285138 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-6d40f536-56e0-4dec-a5d8-4f3d0d3cc787 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:35.285761 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-6d40f536-56e0-4dec-a5d8-4f3d0d3cc787 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] [instance: b510dc8e-9a8c-40dd-9efe-c3f6d747c689] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:35.287759 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG dbcounter [-] [127033] Writing DB stats nova_cell0:SELECT=2 {{(pid=127033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:59:35.288600 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG dbcounter [-] [127033] Writing DB stats nova_cell0:SELECT=6 {{(pid=127033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:59:35.295708 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-6d40f536-56e0-4dec-a5d8-4f3d0d3cc787 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:35.296235 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-6d40f536-56e0-4dec-a5d8-4f3d0d3cc787 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:35.296675 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-6d40f536-56e0-4dec-a5d8-4f3d0d3cc787 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:35.297384 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-6d40f536-56e0-4dec-a5d8-4f3d0d3cc787 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:35.297841 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-6d40f536-56e0-4dec-a5d8-4f3d0d3cc787 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:35.298277 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-6d40f536-56e0-4dec-a5d8-4f3d0d3cc787 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:35.312818 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.wsgi [None req-6d40f536-56e0-4dec-a5d8-4f3d0d3cc787 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] HTTP exception thrown: Instance b510dc8e-9a8c-40dd-9efe-c3f6d747c689 could not be found. Oct 28 09:59:35.314397 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-6d40f536-56e0-4dec-a5d8-4f3d0d3cc787 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Request method failure captured: Oct 28 09:59:35.314397 dv-cinder-zed-3-smb devstack@n-api.service[127033]: request: GET /compute/v2.1/servers/b510dc8e-9a8c-40dd-9efe-c3f6d747c689 HTTP/1.1 Oct 28 09:59:35.314397 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Accept: application/json Oct 28 09:59:35.314397 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Accept-Encoding: identity Oct 28 09:59:35.314397 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Connection: close Oct 28 09:59:35.314397 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Content-Length: 0 Oct 28 09:59:35.314397 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Content-Type: application/json Oct 28 09:59:35.314397 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Host: 10.222.0.52 Oct 28 09:59:35.314397 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Openstack-System-Scope: None Oct 28 09:59:35.314397 dv-cinder-zed-3-smb devstack@n-api.service[127033]: User-Agent: python-urllib3/1.26.12 Oct 28 09:59:35.314397 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Auth-Token: gAAAAABjW6ZlB_y8UlHttqFpTZf-FQqNFL8UpqBADpRqoMnMvW_jAoL6f5CF8d3TJuqshSrx4zOxOgPBQaaPIBzA2l5d4VliO6WO9dxAWAz2QeafoRTcYtg1CKFv-cJOUbVbMelTlyaihpwFtFOGoW8EkNwvlaaR3DGtxA3ButWLQbGRra0UmvI Oct 28 09:59:35.314397 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Domain-Id: None Oct 28 09:59:35.314397 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Domain-Name: None Oct 28 09:59:35.314397 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Identity-Status: Confirmed Oct 28 09:59:35.314397 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Is-Admin-Project: True Oct 28 09:59:35.314397 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Project-Domain-Id: default Oct 28 09:59:35.314397 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Project-Domain-Name: Default Oct 28 09:59:35.314397 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Project-Id: 68e60d7c624e49e1bb43188ae9d7dd2b Oct 28 09:59:35.314397 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Project-Name: tempest-AttachVolumeNegativeTest-21111899 Oct 28 09:59:35.314397 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Role: reader,member Oct 28 09:59:35.314397 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Roles: reader,member Oct 28 09:59:35.316228 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_68e60d7c624e49e1bb43188ae9d7dd2b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/68e60d7c624e49e1bb43188ae9d7dd2b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/68e60d7c624e49e1bb43188ae9d7dd2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/68e60d7c624e49e1bb43188ae9d7dd2b"}]}] Oct 28 09:59:35.316228 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Tenant: tempest-AttachVolumeNegativeTest-21111899 Oct 28 09:59:35.316228 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Tenant-Id: 68e60d7c624e49e1bb43188ae9d7dd2b Oct 28 09:59:35.316228 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-21111899 Oct 28 09:59:35.316228 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User: tempest-AttachVolumeNegativeTest-21111899-project Oct 28 09:59:35.316228 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User-Domain-Id: default Oct 28 09:59:35.316228 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User-Domain-Name: Default Oct 28 09:59:35.316228 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User-Id: d38ce75423b5412d90c1158396978b97 Oct 28 09:59:35.316228 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User-Name: tempest-AttachVolumeNegativeTest-21111899-project Oct 28 09:59:35.316228 dv-cinder-zed-3-smb devstack@n-api.service[127033]: method: > Oct 28 09:59:35.316228 dv-cinder-zed-3-smb devstack@n-api.service[127033]: exception: Instance b510dc8e-9a8c-40dd-9efe-c3f6d747c689 could not be found. Oct 28 09:59:35.316228 dv-cinder-zed-3-smb devstack@n-api.service[127033]: action_args: {'id': 'b510dc8e-9a8c-40dd-9efe-c3f6d747c689'} Oct 28 09:59:35.317326 dv-cinder-zed-3-smb devstack@n-api.service[127033]: {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:59:35.317326 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:59:35.317326 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 09:59:35.317326 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 09:59:35.317326 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 09:59:35.317326 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 09:59:35.317326 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 09:59:35.317326 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 09:59:35.317326 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 09:59:35.317326 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 09:59:35.317326 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b510dc8e-9a8c-40dd-9efe-c3f6d747c689 could not be found. Oct 28 09:59:35.317326 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:59:35.317326 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:59:35.317326 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:59:35.317326 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:59:35.317326 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:59:35.317326 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:59:35.317326 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:59:35.317326 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:59:35.317326 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:59:35.318859 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:59:35.318859 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 09:59:35.318859 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 09:59:35.318859 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 09:59:35.318859 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 09:59:35.318859 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 09:59:35.318859 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 09:59:35.318859 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b510dc8e-9a8c-40dd-9efe-c3f6d747c689 could not be found. Oct 28 09:59:35.318859 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:59:35.318859 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:59:35.318859 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:59:35.318859 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:59:35.318859 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:59:35.318859 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:59:35.318859 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:59:35.318859 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:59:35.318859 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b510dc8e-9a8c-40dd-9efe-c3f6d747c689 could not be found. Oct 28 09:59:35.318859 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:59:35.320286 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-6d40f536-56e0-4dec-a5d8-4f3d0d3cc787 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Returning 404 to user: Instance b510dc8e-9a8c-40dd-9efe-c3f6d747c689 could not be found. {{(pid=127033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:59:35.320286 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-6d40f536-56e0-4dec-a5d8-4f3d0d3cc787 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] 10.222.0.52 "GET /compute/v2.1/servers/b510dc8e-9a8c-40dd-9efe-c3f6d747c689" status: 404 len: 111 microversion: 2.1 time: 0.035272 Oct 28 09:59:35.320286 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 484/987] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:59:35 2022] GET /compute/v2.1/servers/b510dc8e-9a8c-40dd-9efe-c3f6d747c689 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:59:35.324894 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-762fb79b-4034-4237-90e4-4c16bcf4f16f tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Calling method '.version_select at 0x7ff0106160d0>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:35.344338 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-762fb79b-4034-4237-90e4-4c16bcf4f16f tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-922392994" status: 202 len: 0 microversion: 2.1 time: 0.023358 Oct 28 09:59:35.344914 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 504/988] 10.222.0.52 () {58 vars in 1218 bytes} [Fri Oct 28 09:59:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-922392994 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:59:36.420314 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [req-1ed1d8a8-4e0e-49ba-8b6a-b2d925bbbb73 req-b3458aa8-6cad-4f7d-9163-c387cebd3027 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9b6a132-b028-452c-8b88-fc7b27ef8c0f", "tag": "68c29671-d76d-40cf-af9c-23b8f386cff8"}]} {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:59:36.430297 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-1ed1d8a8-4e0e-49ba-8b6a-b2d925bbbb73 req-b3458aa8-6cad-4f7d-9163-c387cebd3027 service nova] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:36.430784 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-1ed1d8a8-4e0e-49ba-8b6a-b2d925bbbb73 req-b3458aa8-6cad-4f7d-9163-c387cebd3027 service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:36.431227 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-1ed1d8a8-4e0e-49ba-8b6a-b2d925bbbb73 req-b3458aa8-6cad-4f7d-9163-c387cebd3027 service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:36.442529 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.compute.server_external_events [req-1ed1d8a8-4e0e-49ba-8b6a-b2d925bbbb73 req-b3458aa8-6cad-4f7d-9163-c387cebd3027 service nova] Creating event network-changed:68c29671-d76d-40cf-af9c-23b8f386cff8 for instance d9b6a132-b028-452c-8b88-fc7b27ef8c0f on hv-cinder-zed-3 Oct 28 09:59:36.447519 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [req-1ed1d8a8-4e0e-49ba-8b6a-b2d925bbbb73 req-b3458aa8-6cad-4f7d-9163-c387cebd3027 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030906 Oct 28 09:59:36.448152 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 485/989] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Oct 28 09:59:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:59:37.105642 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-60dd72fb-185d-43b9-8cbd-b1187ccdc85a tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:37.106294 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-60dd72fb-185d-43b9-8cbd-b1187ccdc85a tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] [instance: b510dc8e-9a8c-40dd-9efe-c3f6d747c689] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:37.113514 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-60dd72fb-185d-43b9-8cbd-b1187ccdc85a tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:37.114145 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-60dd72fb-185d-43b9-8cbd-b1187ccdc85a tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:37.114692 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-60dd72fb-185d-43b9-8cbd-b1187ccdc85a tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:37.115951 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-60dd72fb-185d-43b9-8cbd-b1187ccdc85a tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:37.116382 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-60dd72fb-185d-43b9-8cbd-b1187ccdc85a tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:37.116970 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-60dd72fb-185d-43b9-8cbd-b1187ccdc85a tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:37.132758 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.wsgi [None req-60dd72fb-185d-43b9-8cbd-b1187ccdc85a tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] HTTP exception thrown: Instance b510dc8e-9a8c-40dd-9efe-c3f6d747c689 could not be found. Oct 28 09:59:37.134641 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-60dd72fb-185d-43b9-8cbd-b1187ccdc85a tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Request method failure captured: Oct 28 09:59:37.134641 dv-cinder-zed-3-smb devstack@n-api.service[127032]: request: DELETE /compute/v2.1/servers/b510dc8e-9a8c-40dd-9efe-c3f6d747c689 HTTP/1.1 Oct 28 09:59:37.134641 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Accept: application/json Oct 28 09:59:37.134641 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Accept-Encoding: identity Oct 28 09:59:37.134641 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Connection: close Oct 28 09:59:37.134641 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Content-Length: 0 Oct 28 09:59:37.134641 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Content-Type: application/json Oct 28 09:59:37.134641 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Host: 10.222.0.52 Oct 28 09:59:37.134641 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Openstack-System-Scope: None Oct 28 09:59:37.134641 dv-cinder-zed-3-smb devstack@n-api.service[127032]: User-Agent: python-urllib3/1.26.12 Oct 28 09:59:37.134641 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Auth-Token: gAAAAABjW6ZlB_y8UlHttqFpTZf-FQqNFL8UpqBADpRqoMnMvW_jAoL6f5CF8d3TJuqshSrx4zOxOgPBQaaPIBzA2l5d4VliO6WO9dxAWAz2QeafoRTcYtg1CKFv-cJOUbVbMelTlyaihpwFtFOGoW8EkNwvlaaR3DGtxA3ButWLQbGRra0UmvI Oct 28 09:59:37.134641 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Domain-Id: None Oct 28 09:59:37.134641 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Domain-Name: None Oct 28 09:59:37.134641 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Identity-Status: Confirmed Oct 28 09:59:37.134641 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Is-Admin-Project: True Oct 28 09:59:37.134641 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Project-Domain-Id: default Oct 28 09:59:37.134641 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Project-Domain-Name: Default Oct 28 09:59:37.134641 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Project-Id: 68e60d7c624e49e1bb43188ae9d7dd2b Oct 28 09:59:37.134641 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Project-Name: tempest-AttachVolumeNegativeTest-21111899 Oct 28 09:59:37.134641 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Role: reader,member Oct 28 09:59:37.134641 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Roles: reader,member Oct 28 09:59:37.137649 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_68e60d7c624e49e1bb43188ae9d7dd2b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/68e60d7c624e49e1bb43188ae9d7dd2b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/68e60d7c624e49e1bb43188ae9d7dd2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/68e60d7c624e49e1bb43188ae9d7dd2b"}]}] Oct 28 09:59:37.137649 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Tenant: tempest-AttachVolumeNegativeTest-21111899 Oct 28 09:59:37.137649 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Tenant-Id: 68e60d7c624e49e1bb43188ae9d7dd2b Oct 28 09:59:37.137649 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-21111899 Oct 28 09:59:37.137649 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-User: tempest-AttachVolumeNegativeTest-21111899-project Oct 28 09:59:37.137649 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-User-Domain-Id: default Oct 28 09:59:37.137649 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-User-Domain-Name: Default Oct 28 09:59:37.137649 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-User-Id: d38ce75423b5412d90c1158396978b97 Oct 28 09:59:37.137649 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-User-Name: tempest-AttachVolumeNegativeTest-21111899-project Oct 28 09:59:37.137649 dv-cinder-zed-3-smb devstack@n-api.service[127032]: method: > Oct 28 09:59:37.137649 dv-cinder-zed-3-smb devstack@n-api.service[127032]: exception: Instance b510dc8e-9a8c-40dd-9efe-c3f6d747c689 could not be found. Oct 28 09:59:37.137649 dv-cinder-zed-3-smb devstack@n-api.service[127032]: action_args: {'id': 'b510dc8e-9a8c-40dd-9efe-c3f6d747c689'} Oct 28 09:59:37.139345 dv-cinder-zed-3-smb devstack@n-api.service[127032]: {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:59:37.139345 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:59:37.139345 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 09:59:37.139345 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 09:59:37.139345 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 09:59:37.139345 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 09:59:37.139345 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 09:59:37.139345 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 09:59:37.139345 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 09:59:37.139345 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 09:59:37.139345 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b510dc8e-9a8c-40dd-9efe-c3f6d747c689 could not be found. Oct 28 09:59:37.139345 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Oct 28 09:59:37.139345 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:59:37.139345 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Oct 28 09:59:37.139345 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:59:37.139345 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:59:37.139345 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:59:37.139345 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:59:37.139345 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:59:37.139345 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:59:37.142538 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:59:37.142538 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 09:59:37.142538 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 09:59:37.142538 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 09:59:37.142538 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 09:59:37.142538 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 09:59:37.142538 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 09:59:37.142538 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 09:59:37.142538 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 09:59:37.142538 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b510dc8e-9a8c-40dd-9efe-c3f6d747c689 could not be found. Oct 28 09:59:37.142538 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Oct 28 09:59:37.142538 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:59:37.142538 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Oct 28 09:59:37.142538 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:59:37.142538 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:59:37.142538 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:59:37.142538 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:59:37.142538 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:59:37.142538 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b510dc8e-9a8c-40dd-9efe-c3f6d747c689 could not be found. Oct 28 09:59:37.142538 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Oct 28 09:59:37.145495 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-60dd72fb-185d-43b9-8cbd-b1187ccdc85a tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Returning 404 to user: Instance b510dc8e-9a8c-40dd-9efe-c3f6d747c689 could not be found. {{(pid=127032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:59:37.145495 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-60dd72fb-185d-43b9-8cbd-b1187ccdc85a tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] 10.222.0.52 "DELETE /compute/v2.1/servers/b510dc8e-9a8c-40dd-9efe-c3f6d747c689" status: 404 len: 111 microversion: 2.1 time: 0.035654 Oct 28 09:59:37.149808 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-5333bdcb-84ed-409c-a000-7db6f2576945 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:37.150692 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-5333bdcb-84ed-409c-a000-7db6f2576945 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] [instance: b510dc8e-9a8c-40dd-9efe-c3f6d747c689] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:37.153994 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 505/990] 10.222.0.52 () {58 vars in 1239 bytes} [Fri Oct 28 09:59:37 2022] DELETE /compute/v2.1/servers/b510dc8e-9a8c-40dd-9efe-c3f6d747c689 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:59:37.157707 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-5333bdcb-84ed-409c-a000-7db6f2576945 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:37.158332 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-5333bdcb-84ed-409c-a000-7db6f2576945 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:37.158878 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-5333bdcb-84ed-409c-a000-7db6f2576945 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:37.159766 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-5333bdcb-84ed-409c-a000-7db6f2576945 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:37.160341 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-5333bdcb-84ed-409c-a000-7db6f2576945 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:37.160871 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-5333bdcb-84ed-409c-a000-7db6f2576945 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:37.178902 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.wsgi [None req-5333bdcb-84ed-409c-a000-7db6f2576945 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] HTTP exception thrown: Instance b510dc8e-9a8c-40dd-9efe-c3f6d747c689 could not be found. Oct 28 09:59:37.180599 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-5333bdcb-84ed-409c-a000-7db6f2576945 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Request method failure captured: Oct 28 09:59:37.180599 dv-cinder-zed-3-smb devstack@n-api.service[127033]: request: GET /compute/v2.1/servers/b510dc8e-9a8c-40dd-9efe-c3f6d747c689 HTTP/1.1 Oct 28 09:59:37.180599 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Accept: application/json Oct 28 09:59:37.180599 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Accept-Encoding: identity Oct 28 09:59:37.180599 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Connection: close Oct 28 09:59:37.180599 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Content-Length: 0 Oct 28 09:59:37.180599 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Content-Type: application/json Oct 28 09:59:37.180599 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Host: 10.222.0.52 Oct 28 09:59:37.180599 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Openstack-System-Scope: None Oct 28 09:59:37.180599 dv-cinder-zed-3-smb devstack@n-api.service[127033]: User-Agent: python-urllib3/1.26.12 Oct 28 09:59:37.180599 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Auth-Token: gAAAAABjW6ZlB_y8UlHttqFpTZf-FQqNFL8UpqBADpRqoMnMvW_jAoL6f5CF8d3TJuqshSrx4zOxOgPBQaaPIBzA2l5d4VliO6WO9dxAWAz2QeafoRTcYtg1CKFv-cJOUbVbMelTlyaihpwFtFOGoW8EkNwvlaaR3DGtxA3ButWLQbGRra0UmvI Oct 28 09:59:37.180599 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Domain-Id: None Oct 28 09:59:37.180599 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Domain-Name: None Oct 28 09:59:37.180599 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Identity-Status: Confirmed Oct 28 09:59:37.180599 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Is-Admin-Project: True Oct 28 09:59:37.180599 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Project-Domain-Id: default Oct 28 09:59:37.180599 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Project-Domain-Name: Default Oct 28 09:59:37.180599 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Project-Id: 68e60d7c624e49e1bb43188ae9d7dd2b Oct 28 09:59:37.180599 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Project-Name: tempest-AttachVolumeNegativeTest-21111899 Oct 28 09:59:37.180599 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Role: reader,member Oct 28 09:59:37.180599 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Roles: reader,member Oct 28 09:59:37.182043 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_68e60d7c624e49e1bb43188ae9d7dd2b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/68e60d7c624e49e1bb43188ae9d7dd2b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/68e60d7c624e49e1bb43188ae9d7dd2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/68e60d7c624e49e1bb43188ae9d7dd2b"}]}] Oct 28 09:59:37.182043 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Tenant: tempest-AttachVolumeNegativeTest-21111899 Oct 28 09:59:37.182043 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Tenant-Id: 68e60d7c624e49e1bb43188ae9d7dd2b Oct 28 09:59:37.182043 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-21111899 Oct 28 09:59:37.182043 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User: tempest-AttachVolumeNegativeTest-21111899-project Oct 28 09:59:37.182043 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User-Domain-Id: default Oct 28 09:59:37.182043 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User-Domain-Name: Default Oct 28 09:59:37.182043 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User-Id: d38ce75423b5412d90c1158396978b97 Oct 28 09:59:37.182043 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User-Name: tempest-AttachVolumeNegativeTest-21111899-project Oct 28 09:59:37.182043 dv-cinder-zed-3-smb devstack@n-api.service[127033]: method: > Oct 28 09:59:37.182043 dv-cinder-zed-3-smb devstack@n-api.service[127033]: exception: Instance b510dc8e-9a8c-40dd-9efe-c3f6d747c689 could not be found. Oct 28 09:59:37.182043 dv-cinder-zed-3-smb devstack@n-api.service[127033]: action_args: {'id': 'b510dc8e-9a8c-40dd-9efe-c3f6d747c689'} Oct 28 09:59:37.182857 dv-cinder-zed-3-smb devstack@n-api.service[127033]: {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:59:37.182857 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:59:37.182857 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 09:59:37.182857 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 09:59:37.182857 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 09:59:37.182857 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 09:59:37.182857 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 09:59:37.182857 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 09:59:37.182857 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 09:59:37.182857 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 09:59:37.182857 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b510dc8e-9a8c-40dd-9efe-c3f6d747c689 could not be found. Oct 28 09:59:37.182857 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:59:37.182857 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:59:37.182857 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:59:37.182857 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:59:37.182857 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:59:37.182857 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:59:37.182857 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:59:37.182857 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:59:37.182857 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:59:37.185026 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:59:37.185026 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 09:59:37.185026 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 09:59:37.185026 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 09:59:37.185026 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 09:59:37.185026 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 09:59:37.185026 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 09:59:37.185026 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b510dc8e-9a8c-40dd-9efe-c3f6d747c689 could not be found. Oct 28 09:59:37.185026 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:59:37.185026 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:59:37.185026 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:59:37.185026 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:59:37.185026 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:59:37.185026 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:59:37.185026 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:59:37.185026 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:59:37.185026 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b510dc8e-9a8c-40dd-9efe-c3f6d747c689 could not be found. Oct 28 09:59:37.185026 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:59:37.188279 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-5333bdcb-84ed-409c-a000-7db6f2576945 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Returning 404 to user: Instance b510dc8e-9a8c-40dd-9efe-c3f6d747c689 could not be found. {{(pid=127033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:59:37.188279 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-5333bdcb-84ed-409c-a000-7db6f2576945 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] 10.222.0.52 "GET /compute/v2.1/servers/b510dc8e-9a8c-40dd-9efe-c3f6d747c689" status: 404 len: 111 microversion: 2.1 time: 0.037365 Oct 28 09:59:37.188279 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 486/991] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:59:37 2022] GET /compute/v2.1/servers/b510dc8e-9a8c-40dd-9efe-c3f6d747c689 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:59:38.343457 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-b529d597-4068-44ed-abc1-c8d25903329c tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:38.343969 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-b529d597-4068-44ed-abc1-c8d25903329c tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] [instance: 6be25faa-d7aa-4bd8-9bc5-b1f2615b1fea] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:38.350379 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-b529d597-4068-44ed-abc1-c8d25903329c tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:38.350864 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-b529d597-4068-44ed-abc1-c8d25903329c tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:38.351304 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-b529d597-4068-44ed-abc1-c8d25903329c tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:38.352029 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-b529d597-4068-44ed-abc1-c8d25903329c tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:38.352487 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-b529d597-4068-44ed-abc1-c8d25903329c tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:38.352915 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-b529d597-4068-44ed-abc1-c8d25903329c tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:38.367335 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.wsgi [None req-b529d597-4068-44ed-abc1-c8d25903329c tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] HTTP exception thrown: Instance 6be25faa-d7aa-4bd8-9bc5-b1f2615b1fea could not be found. Oct 28 09:59:38.368903 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-b529d597-4068-44ed-abc1-c8d25903329c tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Request method failure captured: Oct 28 09:59:38.368903 dv-cinder-zed-3-smb devstack@n-api.service[127032]: request: DELETE /compute/v2.1/servers/6be25faa-d7aa-4bd8-9bc5-b1f2615b1fea HTTP/1.1 Oct 28 09:59:38.368903 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Accept: application/json Oct 28 09:59:38.368903 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Accept-Encoding: identity Oct 28 09:59:38.368903 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Connection: close Oct 28 09:59:38.368903 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Content-Length: 0 Oct 28 09:59:38.368903 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Content-Type: application/json Oct 28 09:59:38.368903 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Host: 10.222.0.52 Oct 28 09:59:38.368903 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Openstack-System-Scope: None Oct 28 09:59:38.368903 dv-cinder-zed-3-smb devstack@n-api.service[127032]: User-Agent: python-urllib3/1.26.12 Oct 28 09:59:38.368903 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Auth-Token: gAAAAABjW6ZlB_y8UlHttqFpTZf-FQqNFL8UpqBADpRqoMnMvW_jAoL6f5CF8d3TJuqshSrx4zOxOgPBQaaPIBzA2l5d4VliO6WO9dxAWAz2QeafoRTcYtg1CKFv-cJOUbVbMelTlyaihpwFtFOGoW8EkNwvlaaR3DGtxA3ButWLQbGRra0UmvI Oct 28 09:59:38.368903 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Domain-Id: None Oct 28 09:59:38.368903 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Domain-Name: None Oct 28 09:59:38.368903 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Identity-Status: Confirmed Oct 28 09:59:38.368903 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Is-Admin-Project: True Oct 28 09:59:38.368903 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Project-Domain-Id: default Oct 28 09:59:38.368903 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Project-Domain-Name: Default Oct 28 09:59:38.368903 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Project-Id: 68e60d7c624e49e1bb43188ae9d7dd2b Oct 28 09:59:38.368903 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Project-Name: tempest-AttachVolumeNegativeTest-21111899 Oct 28 09:59:38.368903 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Role: reader,member Oct 28 09:59:38.368903 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Roles: reader,member Oct 28 09:59:38.370502 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_68e60d7c624e49e1bb43188ae9d7dd2b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/68e60d7c624e49e1bb43188ae9d7dd2b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/68e60d7c624e49e1bb43188ae9d7dd2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/68e60d7c624e49e1bb43188ae9d7dd2b"}]}] Oct 28 09:59:38.370502 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Tenant: tempest-AttachVolumeNegativeTest-21111899 Oct 28 09:59:38.370502 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Tenant-Id: 68e60d7c624e49e1bb43188ae9d7dd2b Oct 28 09:59:38.370502 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-21111899 Oct 28 09:59:38.370502 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-User: tempest-AttachVolumeNegativeTest-21111899-project Oct 28 09:59:38.370502 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-User-Domain-Id: default Oct 28 09:59:38.370502 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-User-Domain-Name: Default Oct 28 09:59:38.370502 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-User-Id: d38ce75423b5412d90c1158396978b97 Oct 28 09:59:38.370502 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-User-Name: tempest-AttachVolumeNegativeTest-21111899-project Oct 28 09:59:38.370502 dv-cinder-zed-3-smb devstack@n-api.service[127032]: method: > Oct 28 09:59:38.370502 dv-cinder-zed-3-smb devstack@n-api.service[127032]: exception: Instance 6be25faa-d7aa-4bd8-9bc5-b1f2615b1fea could not be found. Oct 28 09:59:38.370502 dv-cinder-zed-3-smb devstack@n-api.service[127032]: action_args: {'id': '6be25faa-d7aa-4bd8-9bc5-b1f2615b1fea'} Oct 28 09:59:38.371410 dv-cinder-zed-3-smb devstack@n-api.service[127032]: {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:59:38.371410 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:59:38.371410 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 09:59:38.371410 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 09:59:38.371410 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 09:59:38.371410 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 09:59:38.371410 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 09:59:38.371410 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 09:59:38.371410 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 09:59:38.371410 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 09:59:38.371410 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6be25faa-d7aa-4bd8-9bc5-b1f2615b1fea could not be found. Oct 28 09:59:38.371410 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Oct 28 09:59:38.371410 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:59:38.371410 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Oct 28 09:59:38.371410 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:59:38.371410 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:59:38.371410 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:59:38.371410 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:59:38.371410 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:59:38.371410 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:59:38.372934 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:59:38.372934 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 09:59:38.372934 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 09:59:38.372934 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 09:59:38.372934 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 09:59:38.372934 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 09:59:38.372934 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 09:59:38.372934 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 09:59:38.372934 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 09:59:38.372934 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6be25faa-d7aa-4bd8-9bc5-b1f2615b1fea could not be found. Oct 28 09:59:38.372934 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Oct 28 09:59:38.372934 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:59:38.372934 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Oct 28 09:59:38.372934 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:59:38.372934 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:59:38.372934 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:59:38.372934 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:59:38.372934 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:59:38.372934 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6be25faa-d7aa-4bd8-9bc5-b1f2615b1fea could not be found. Oct 28 09:59:38.372934 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Oct 28 09:59:38.374405 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-b529d597-4068-44ed-abc1-c8d25903329c tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Returning 404 to user: Instance 6be25faa-d7aa-4bd8-9bc5-b1f2615b1fea could not be found. {{(pid=127032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:59:38.374405 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-b529d597-4068-44ed-abc1-c8d25903329c tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] 10.222.0.52 "DELETE /compute/v2.1/servers/6be25faa-d7aa-4bd8-9bc5-b1f2615b1fea" status: 404 len: 111 microversion: 2.1 time: 0.030690 Oct 28 09:59:38.374405 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 506/992] 10.222.0.52 () {58 vars in 1239 bytes} [Fri Oct 28 09:59:38 2022] DELETE /compute/v2.1/servers/6be25faa-d7aa-4bd8-9bc5-b1f2615b1fea => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:59:38.379865 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-9bcd00c0-eafb-4e4f-bb97-68d255ab50bb tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:38.380502 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-9bcd00c0-eafb-4e4f-bb97-68d255ab50bb tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] [instance: 6be25faa-d7aa-4bd8-9bc5-b1f2615b1fea] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:38.386902 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-9bcd00c0-eafb-4e4f-bb97-68d255ab50bb tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:38.387387 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-9bcd00c0-eafb-4e4f-bb97-68d255ab50bb tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:38.387860 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-9bcd00c0-eafb-4e4f-bb97-68d255ab50bb tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:38.388547 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-9bcd00c0-eafb-4e4f-bb97-68d255ab50bb tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:38.389005 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-9bcd00c0-eafb-4e4f-bb97-68d255ab50bb tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:38.389427 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-9bcd00c0-eafb-4e4f-bb97-68d255ab50bb tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:38.403407 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.wsgi [None req-9bcd00c0-eafb-4e4f-bb97-68d255ab50bb tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] HTTP exception thrown: Instance 6be25faa-d7aa-4bd8-9bc5-b1f2615b1fea could not be found. Oct 28 09:59:38.404947 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-9bcd00c0-eafb-4e4f-bb97-68d255ab50bb tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Request method failure captured: Oct 28 09:59:38.404947 dv-cinder-zed-3-smb devstack@n-api.service[127033]: request: GET /compute/v2.1/servers/6be25faa-d7aa-4bd8-9bc5-b1f2615b1fea HTTP/1.1 Oct 28 09:59:38.404947 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Accept: application/json Oct 28 09:59:38.404947 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Accept-Encoding: identity Oct 28 09:59:38.404947 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Connection: close Oct 28 09:59:38.404947 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Content-Length: 0 Oct 28 09:59:38.404947 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Content-Type: application/json Oct 28 09:59:38.404947 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Host: 10.222.0.52 Oct 28 09:59:38.404947 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Openstack-System-Scope: None Oct 28 09:59:38.404947 dv-cinder-zed-3-smb devstack@n-api.service[127033]: User-Agent: python-urllib3/1.26.12 Oct 28 09:59:38.404947 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Auth-Token: gAAAAABjW6ZlB_y8UlHttqFpTZf-FQqNFL8UpqBADpRqoMnMvW_jAoL6f5CF8d3TJuqshSrx4zOxOgPBQaaPIBzA2l5d4VliO6WO9dxAWAz2QeafoRTcYtg1CKFv-cJOUbVbMelTlyaihpwFtFOGoW8EkNwvlaaR3DGtxA3ButWLQbGRra0UmvI Oct 28 09:59:38.404947 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Domain-Id: None Oct 28 09:59:38.404947 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Domain-Name: None Oct 28 09:59:38.404947 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Identity-Status: Confirmed Oct 28 09:59:38.404947 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Is-Admin-Project: True Oct 28 09:59:38.404947 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Project-Domain-Id: default Oct 28 09:59:38.404947 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Project-Domain-Name: Default Oct 28 09:59:38.404947 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Project-Id: 68e60d7c624e49e1bb43188ae9d7dd2b Oct 28 09:59:38.404947 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Project-Name: tempest-AttachVolumeNegativeTest-21111899 Oct 28 09:59:38.404947 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Role: reader,member Oct 28 09:59:38.404947 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Roles: reader,member Oct 28 09:59:38.406525 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_68e60d7c624e49e1bb43188ae9d7dd2b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/68e60d7c624e49e1bb43188ae9d7dd2b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/68e60d7c624e49e1bb43188ae9d7dd2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/68e60d7c624e49e1bb43188ae9d7dd2b"}]}] Oct 28 09:59:38.406525 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Tenant: tempest-AttachVolumeNegativeTest-21111899 Oct 28 09:59:38.406525 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Tenant-Id: 68e60d7c624e49e1bb43188ae9d7dd2b Oct 28 09:59:38.406525 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-21111899 Oct 28 09:59:38.406525 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User: tempest-AttachVolumeNegativeTest-21111899-project Oct 28 09:59:38.406525 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User-Domain-Id: default Oct 28 09:59:38.406525 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User-Domain-Name: Default Oct 28 09:59:38.406525 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User-Id: d38ce75423b5412d90c1158396978b97 Oct 28 09:59:38.406525 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User-Name: tempest-AttachVolumeNegativeTest-21111899-project Oct 28 09:59:38.406525 dv-cinder-zed-3-smb devstack@n-api.service[127033]: method: > Oct 28 09:59:38.406525 dv-cinder-zed-3-smb devstack@n-api.service[127033]: exception: Instance 6be25faa-d7aa-4bd8-9bc5-b1f2615b1fea could not be found. Oct 28 09:59:38.406525 dv-cinder-zed-3-smb devstack@n-api.service[127033]: action_args: {'id': '6be25faa-d7aa-4bd8-9bc5-b1f2615b1fea'} Oct 28 09:59:38.407525 dv-cinder-zed-3-smb devstack@n-api.service[127033]: {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:59:38.407525 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:59:38.407525 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 09:59:38.407525 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 09:59:38.407525 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 09:59:38.407525 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 09:59:38.407525 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 09:59:38.407525 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 09:59:38.407525 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 09:59:38.407525 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 09:59:38.407525 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6be25faa-d7aa-4bd8-9bc5-b1f2615b1fea could not be found. Oct 28 09:59:38.407525 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:59:38.407525 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:59:38.407525 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:59:38.407525 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:59:38.407525 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:59:38.407525 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:59:38.407525 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:59:38.407525 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:59:38.407525 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:59:38.409054 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:59:38.409054 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 09:59:38.409054 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 09:59:38.409054 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 09:59:38.409054 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 09:59:38.409054 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 09:59:38.409054 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 09:59:38.409054 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6be25faa-d7aa-4bd8-9bc5-b1f2615b1fea could not be found. Oct 28 09:59:38.409054 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:59:38.409054 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:59:38.409054 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:59:38.409054 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:59:38.409054 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:59:38.409054 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:59:38.409054 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:59:38.409054 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:59:38.409054 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6be25faa-d7aa-4bd8-9bc5-b1f2615b1fea could not be found. Oct 28 09:59:38.409054 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:59:38.410636 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-9bcd00c0-eafb-4e4f-bb97-68d255ab50bb tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Returning 404 to user: Instance 6be25faa-d7aa-4bd8-9bc5-b1f2615b1fea could not be found. {{(pid=127033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:59:38.410636 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-9bcd00c0-eafb-4e4f-bb97-68d255ab50bb tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] 10.222.0.52 "GET /compute/v2.1/servers/6be25faa-d7aa-4bd8-9bc5-b1f2615b1fea" status: 404 len: 111 microversion: 2.1 time: 0.031204 Oct 28 09:59:38.410636 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 487/993] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:59:38 2022] GET /compute/v2.1/servers/6be25faa-d7aa-4bd8-9bc5-b1f2615b1fea => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:59:38.414808 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-0760a781-0769-4462-8bc2-72002d781069 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:38.415333 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-0760a781-0769-4462-8bc2-72002d781069 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] [instance: 91ca6322-9cdc-4106-8021-811be2c4af7f] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:38.421298 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-0760a781-0769-4462-8bc2-72002d781069 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:38.421786 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-0760a781-0769-4462-8bc2-72002d781069 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:38.422224 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-0760a781-0769-4462-8bc2-72002d781069 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:38.422916 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-0760a781-0769-4462-8bc2-72002d781069 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:38.423377 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-0760a781-0769-4462-8bc2-72002d781069 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:38.423919 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-0760a781-0769-4462-8bc2-72002d781069 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:38.437307 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.wsgi [None req-0760a781-0769-4462-8bc2-72002d781069 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] HTTP exception thrown: Instance 91ca6322-9cdc-4106-8021-811be2c4af7f could not be found. Oct 28 09:59:38.438948 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-0760a781-0769-4462-8bc2-72002d781069 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Request method failure captured: Oct 28 09:59:38.438948 dv-cinder-zed-3-smb devstack@n-api.service[127032]: request: DELETE /compute/v2.1/servers/91ca6322-9cdc-4106-8021-811be2c4af7f HTTP/1.1 Oct 28 09:59:38.438948 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Accept: application/json Oct 28 09:59:38.438948 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Accept-Encoding: identity Oct 28 09:59:38.438948 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Connection: close Oct 28 09:59:38.438948 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Content-Length: 0 Oct 28 09:59:38.438948 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Content-Type: application/json Oct 28 09:59:38.438948 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Host: 10.222.0.52 Oct 28 09:59:38.438948 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Openstack-System-Scope: None Oct 28 09:59:38.438948 dv-cinder-zed-3-smb devstack@n-api.service[127032]: User-Agent: python-urllib3/1.26.12 Oct 28 09:59:38.438948 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Auth-Token: gAAAAABjW6ZlB_y8UlHttqFpTZf-FQqNFL8UpqBADpRqoMnMvW_jAoL6f5CF8d3TJuqshSrx4zOxOgPBQaaPIBzA2l5d4VliO6WO9dxAWAz2QeafoRTcYtg1CKFv-cJOUbVbMelTlyaihpwFtFOGoW8EkNwvlaaR3DGtxA3ButWLQbGRra0UmvI Oct 28 09:59:38.438948 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Domain-Id: None Oct 28 09:59:38.438948 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Domain-Name: None Oct 28 09:59:38.438948 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Identity-Status: Confirmed Oct 28 09:59:38.438948 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Is-Admin-Project: True Oct 28 09:59:38.438948 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Project-Domain-Id: default Oct 28 09:59:38.438948 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Project-Domain-Name: Default Oct 28 09:59:38.438948 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Project-Id: 68e60d7c624e49e1bb43188ae9d7dd2b Oct 28 09:59:38.438948 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Project-Name: tempest-AttachVolumeNegativeTest-21111899 Oct 28 09:59:38.438948 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Role: reader,member Oct 28 09:59:38.438948 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Roles: reader,member Oct 28 09:59:38.441083 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_68e60d7c624e49e1bb43188ae9d7dd2b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/68e60d7c624e49e1bb43188ae9d7dd2b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/68e60d7c624e49e1bb43188ae9d7dd2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/68e60d7c624e49e1bb43188ae9d7dd2b"}]}] Oct 28 09:59:38.441083 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Tenant: tempest-AttachVolumeNegativeTest-21111899 Oct 28 09:59:38.441083 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Tenant-Id: 68e60d7c624e49e1bb43188ae9d7dd2b Oct 28 09:59:38.441083 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-21111899 Oct 28 09:59:38.441083 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-User: tempest-AttachVolumeNegativeTest-21111899-project Oct 28 09:59:38.441083 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-User-Domain-Id: default Oct 28 09:59:38.441083 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-User-Domain-Name: Default Oct 28 09:59:38.441083 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-User-Id: d38ce75423b5412d90c1158396978b97 Oct 28 09:59:38.441083 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-User-Name: tempest-AttachVolumeNegativeTest-21111899-project Oct 28 09:59:38.441083 dv-cinder-zed-3-smb devstack@n-api.service[127032]: method: > Oct 28 09:59:38.441083 dv-cinder-zed-3-smb devstack@n-api.service[127032]: exception: Instance 91ca6322-9cdc-4106-8021-811be2c4af7f could not be found. Oct 28 09:59:38.441083 dv-cinder-zed-3-smb devstack@n-api.service[127032]: action_args: {'id': '91ca6322-9cdc-4106-8021-811be2c4af7f'} Oct 28 09:59:38.441978 dv-cinder-zed-3-smb devstack@n-api.service[127032]: {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:59:38.441978 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:59:38.441978 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 09:59:38.441978 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 09:59:38.441978 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 09:59:38.441978 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 09:59:38.441978 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 09:59:38.441978 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 09:59:38.441978 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 09:59:38.441978 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 09:59:38.441978 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91ca6322-9cdc-4106-8021-811be2c4af7f could not be found. Oct 28 09:59:38.441978 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Oct 28 09:59:38.441978 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:59:38.441978 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Oct 28 09:59:38.441978 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:59:38.441978 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:59:38.441978 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:59:38.441978 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:59:38.441978 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:59:38.441978 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:59:38.443440 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:59:38.443440 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 09:59:38.443440 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 09:59:38.443440 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 09:59:38.443440 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 09:59:38.443440 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 09:59:38.443440 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 09:59:38.443440 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 09:59:38.443440 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 09:59:38.443440 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91ca6322-9cdc-4106-8021-811be2c4af7f could not be found. Oct 28 09:59:38.443440 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Oct 28 09:59:38.443440 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:59:38.443440 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Oct 28 09:59:38.443440 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:59:38.443440 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:59:38.443440 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:59:38.443440 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:59:38.443440 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:59:38.443440 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91ca6322-9cdc-4106-8021-811be2c4af7f could not be found. Oct 28 09:59:38.443440 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Oct 28 09:59:38.445000 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-0760a781-0769-4462-8bc2-72002d781069 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Returning 404 to user: Instance 91ca6322-9cdc-4106-8021-811be2c4af7f could not be found. {{(pid=127032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:59:38.445000 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-0760a781-0769-4462-8bc2-72002d781069 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] 10.222.0.52 "DELETE /compute/v2.1/servers/91ca6322-9cdc-4106-8021-811be2c4af7f" status: 404 len: 111 microversion: 2.1 time: 0.029447 Oct 28 09:59:38.445000 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 507/994] 10.222.0.52 () {58 vars in 1239 bytes} [Fri Oct 28 09:59:38 2022] DELETE /compute/v2.1/servers/91ca6322-9cdc-4106-8021-811be2c4af7f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:59:38.449233 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-ee0b9ee8-2f97-4b35-b291-f44fe815c105 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:38.449875 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-ee0b9ee8-2f97-4b35-b291-f44fe815c105 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] [instance: 91ca6322-9cdc-4106-8021-811be2c4af7f] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:38.455771 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-ee0b9ee8-2f97-4b35-b291-f44fe815c105 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:38.456900 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-ee0b9ee8-2f97-4b35-b291-f44fe815c105 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:38.457326 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-ee0b9ee8-2f97-4b35-b291-f44fe815c105 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:38.458010 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-ee0b9ee8-2f97-4b35-b291-f44fe815c105 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:38.458560 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-ee0b9ee8-2f97-4b35-b291-f44fe815c105 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:38.458887 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-ee0b9ee8-2f97-4b35-b291-f44fe815c105 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:38.472126 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.wsgi [None req-ee0b9ee8-2f97-4b35-b291-f44fe815c105 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] HTTP exception thrown: Instance 91ca6322-9cdc-4106-8021-811be2c4af7f could not be found. Oct 28 09:59:38.473646 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-ee0b9ee8-2f97-4b35-b291-f44fe815c105 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Request method failure captured: Oct 28 09:59:38.473646 dv-cinder-zed-3-smb devstack@n-api.service[127033]: request: GET /compute/v2.1/servers/91ca6322-9cdc-4106-8021-811be2c4af7f HTTP/1.1 Oct 28 09:59:38.473646 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Accept: application/json Oct 28 09:59:38.473646 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Accept-Encoding: identity Oct 28 09:59:38.473646 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Connection: close Oct 28 09:59:38.473646 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Content-Length: 0 Oct 28 09:59:38.473646 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Content-Type: application/json Oct 28 09:59:38.473646 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Host: 10.222.0.52 Oct 28 09:59:38.473646 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Openstack-System-Scope: None Oct 28 09:59:38.473646 dv-cinder-zed-3-smb devstack@n-api.service[127033]: User-Agent: python-urllib3/1.26.12 Oct 28 09:59:38.473646 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Auth-Token: gAAAAABjW6ZlB_y8UlHttqFpTZf-FQqNFL8UpqBADpRqoMnMvW_jAoL6f5CF8d3TJuqshSrx4zOxOgPBQaaPIBzA2l5d4VliO6WO9dxAWAz2QeafoRTcYtg1CKFv-cJOUbVbMelTlyaihpwFtFOGoW8EkNwvlaaR3DGtxA3ButWLQbGRra0UmvI Oct 28 09:59:38.473646 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Domain-Id: None Oct 28 09:59:38.473646 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Domain-Name: None Oct 28 09:59:38.473646 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Identity-Status: Confirmed Oct 28 09:59:38.473646 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Is-Admin-Project: True Oct 28 09:59:38.473646 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Project-Domain-Id: default Oct 28 09:59:38.473646 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Project-Domain-Name: Default Oct 28 09:59:38.473646 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Project-Id: 68e60d7c624e49e1bb43188ae9d7dd2b Oct 28 09:59:38.473646 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Project-Name: tempest-AttachVolumeNegativeTest-21111899 Oct 28 09:59:38.473646 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Role: reader,member Oct 28 09:59:38.473646 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Roles: reader,member Oct 28 09:59:38.475218 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_68e60d7c624e49e1bb43188ae9d7dd2b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/68e60d7c624e49e1bb43188ae9d7dd2b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/68e60d7c624e49e1bb43188ae9d7dd2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/68e60d7c624e49e1bb43188ae9d7dd2b"}]}] Oct 28 09:59:38.475218 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Tenant: tempest-AttachVolumeNegativeTest-21111899 Oct 28 09:59:38.475218 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Tenant-Id: 68e60d7c624e49e1bb43188ae9d7dd2b Oct 28 09:59:38.475218 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-21111899 Oct 28 09:59:38.475218 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User: tempest-AttachVolumeNegativeTest-21111899-project Oct 28 09:59:38.475218 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User-Domain-Id: default Oct 28 09:59:38.475218 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User-Domain-Name: Default Oct 28 09:59:38.475218 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User-Id: d38ce75423b5412d90c1158396978b97 Oct 28 09:59:38.475218 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User-Name: tempest-AttachVolumeNegativeTest-21111899-project Oct 28 09:59:38.475218 dv-cinder-zed-3-smb devstack@n-api.service[127033]: method: > Oct 28 09:59:38.475218 dv-cinder-zed-3-smb devstack@n-api.service[127033]: exception: Instance 91ca6322-9cdc-4106-8021-811be2c4af7f could not be found. Oct 28 09:59:38.475218 dv-cinder-zed-3-smb devstack@n-api.service[127033]: action_args: {'id': '91ca6322-9cdc-4106-8021-811be2c4af7f'} Oct 28 09:59:38.476204 dv-cinder-zed-3-smb devstack@n-api.service[127033]: {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:59:38.476204 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:59:38.476204 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 09:59:38.476204 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 09:59:38.476204 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 09:59:38.476204 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 09:59:38.476204 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 09:59:38.476204 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 09:59:38.476204 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 09:59:38.476204 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 09:59:38.476204 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91ca6322-9cdc-4106-8021-811be2c4af7f could not be found. Oct 28 09:59:38.476204 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:59:38.476204 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:59:38.476204 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:59:38.476204 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:59:38.476204 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:59:38.476204 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:59:38.476204 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:59:38.476204 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:59:38.476204 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:59:38.477683 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:59:38.477683 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 09:59:38.477683 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 09:59:38.477683 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 09:59:38.477683 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 09:59:38.477683 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 09:59:38.477683 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 09:59:38.477683 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91ca6322-9cdc-4106-8021-811be2c4af7f could not be found. Oct 28 09:59:38.477683 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:59:38.477683 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:59:38.477683 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:59:38.477683 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:59:38.477683 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:59:38.477683 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:59:38.477683 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:59:38.477683 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:59:38.477683 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91ca6322-9cdc-4106-8021-811be2c4af7f could not be found. Oct 28 09:59:38.477683 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:59:38.479267 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-ee0b9ee8-2f97-4b35-b291-f44fe815c105 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Returning 404 to user: Instance 91ca6322-9cdc-4106-8021-811be2c4af7f could not be found. {{(pid=127033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:59:38.479267 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-ee0b9ee8-2f97-4b35-b291-f44fe815c105 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] 10.222.0.52 "GET /compute/v2.1/servers/91ca6322-9cdc-4106-8021-811be2c4af7f" status: 404 len: 111 microversion: 2.1 time: 0.029671 Oct 28 09:59:38.479267 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 488/995] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:59:38 2022] GET /compute/v2.1/servers/91ca6322-9cdc-4106-8021-811be2c4af7f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:59:39.612943 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-ef350410-b84b-470e-a2d9-39edc65a32c0 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:39.614029 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-ef350410-b84b-470e-a2d9-39edc65a32c0 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] [instance: 239cbe4b-b0d1-4361-80af-f3015cb39176] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:39.620448 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ef350410-b84b-470e-a2d9-39edc65a32c0 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:39.620934 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ef350410-b84b-470e-a2d9-39edc65a32c0 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:39.621368 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ef350410-b84b-470e-a2d9-39edc65a32c0 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:39.622064 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ef350410-b84b-470e-a2d9-39edc65a32c0 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:39.622523 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ef350410-b84b-470e-a2d9-39edc65a32c0 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:39.622948 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ef350410-b84b-470e-a2d9-39edc65a32c0 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:39.637464 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.wsgi [None req-ef350410-b84b-470e-a2d9-39edc65a32c0 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] HTTP exception thrown: Instance 239cbe4b-b0d1-4361-80af-f3015cb39176 could not be found. Oct 28 09:59:39.639118 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-ef350410-b84b-470e-a2d9-39edc65a32c0 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Request method failure captured: Oct 28 09:59:39.639118 dv-cinder-zed-3-smb devstack@n-api.service[127032]: request: DELETE /compute/v2.1/servers/239cbe4b-b0d1-4361-80af-f3015cb39176 HTTP/1.1 Oct 28 09:59:39.639118 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Accept: application/json Oct 28 09:59:39.639118 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Accept-Encoding: identity Oct 28 09:59:39.639118 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Connection: close Oct 28 09:59:39.639118 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Content-Length: 0 Oct 28 09:59:39.639118 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Content-Type: application/json Oct 28 09:59:39.639118 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Host: 10.222.0.52 Oct 28 09:59:39.639118 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Openstack-System-Scope: None Oct 28 09:59:39.639118 dv-cinder-zed-3-smb devstack@n-api.service[127032]: User-Agent: python-urllib3/1.26.12 Oct 28 09:59:39.639118 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Auth-Token: gAAAAABjW6ZlB_y8UlHttqFpTZf-FQqNFL8UpqBADpRqoMnMvW_jAoL6f5CF8d3TJuqshSrx4zOxOgPBQaaPIBzA2l5d4VliO6WO9dxAWAz2QeafoRTcYtg1CKFv-cJOUbVbMelTlyaihpwFtFOGoW8EkNwvlaaR3DGtxA3ButWLQbGRra0UmvI Oct 28 09:59:39.639118 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Domain-Id: None Oct 28 09:59:39.639118 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Domain-Name: None Oct 28 09:59:39.639118 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Identity-Status: Confirmed Oct 28 09:59:39.639118 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Is-Admin-Project: True Oct 28 09:59:39.639118 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Project-Domain-Id: default Oct 28 09:59:39.639118 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Project-Domain-Name: Default Oct 28 09:59:39.639118 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Project-Id: 68e60d7c624e49e1bb43188ae9d7dd2b Oct 28 09:59:39.639118 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Project-Name: tempest-AttachVolumeNegativeTest-21111899 Oct 28 09:59:39.639118 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Role: reader,member Oct 28 09:59:39.639118 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Roles: reader,member Oct 28 09:59:39.640872 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_68e60d7c624e49e1bb43188ae9d7dd2b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/68e60d7c624e49e1bb43188ae9d7dd2b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/68e60d7c624e49e1bb43188ae9d7dd2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/68e60d7c624e49e1bb43188ae9d7dd2b"}]}] Oct 28 09:59:39.640872 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Tenant: tempest-AttachVolumeNegativeTest-21111899 Oct 28 09:59:39.640872 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Tenant-Id: 68e60d7c624e49e1bb43188ae9d7dd2b Oct 28 09:59:39.640872 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-21111899 Oct 28 09:59:39.640872 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-User: tempest-AttachVolumeNegativeTest-21111899-project Oct 28 09:59:39.640872 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-User-Domain-Id: default Oct 28 09:59:39.640872 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-User-Domain-Name: Default Oct 28 09:59:39.640872 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-User-Id: d38ce75423b5412d90c1158396978b97 Oct 28 09:59:39.640872 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-User-Name: tempest-AttachVolumeNegativeTest-21111899-project Oct 28 09:59:39.640872 dv-cinder-zed-3-smb devstack@n-api.service[127032]: method: > Oct 28 09:59:39.640872 dv-cinder-zed-3-smb devstack@n-api.service[127032]: exception: Instance 239cbe4b-b0d1-4361-80af-f3015cb39176 could not be found. Oct 28 09:59:39.640872 dv-cinder-zed-3-smb devstack@n-api.service[127032]: action_args: {'id': '239cbe4b-b0d1-4361-80af-f3015cb39176'} Oct 28 09:59:39.641803 dv-cinder-zed-3-smb devstack@n-api.service[127032]: {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:59:39.641803 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:59:39.641803 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 09:59:39.641803 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 09:59:39.641803 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 09:59:39.641803 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 09:59:39.641803 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 09:59:39.641803 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 09:59:39.641803 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 09:59:39.641803 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 09:59:39.641803 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 239cbe4b-b0d1-4361-80af-f3015cb39176 could not be found. Oct 28 09:59:39.641803 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Oct 28 09:59:39.641803 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:59:39.641803 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Oct 28 09:59:39.641803 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:59:39.641803 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:59:39.641803 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:59:39.641803 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:59:39.641803 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:59:39.641803 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:59:39.643303 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:59:39.643303 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 09:59:39.643303 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 09:59:39.643303 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 09:59:39.643303 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 09:59:39.643303 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 09:59:39.643303 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 09:59:39.643303 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 09:59:39.643303 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 09:59:39.643303 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 239cbe4b-b0d1-4361-80af-f3015cb39176 could not be found. Oct 28 09:59:39.643303 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Oct 28 09:59:39.643303 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:59:39.643303 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Oct 28 09:59:39.643303 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:59:39.643303 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:59:39.643303 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:59:39.643303 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:59:39.643303 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:59:39.643303 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 239cbe4b-b0d1-4361-80af-f3015cb39176 could not be found. Oct 28 09:59:39.643303 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Oct 28 09:59:39.644862 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-ef350410-b84b-470e-a2d9-39edc65a32c0 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Returning 404 to user: Instance 239cbe4b-b0d1-4361-80af-f3015cb39176 could not be found. {{(pid=127032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:59:39.644862 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-ef350410-b84b-470e-a2d9-39edc65a32c0 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] 10.222.0.52 "DELETE /compute/v2.1/servers/239cbe4b-b0d1-4361-80af-f3015cb39176" status: 404 len: 111 microversion: 2.1 time: 0.031599 Oct 28 09:59:39.644862 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 508/996] 10.222.0.52 () {58 vars in 1239 bytes} [Fri Oct 28 09:59:39 2022] DELETE /compute/v2.1/servers/239cbe4b-b0d1-4361-80af-f3015cb39176 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:59:39.649041 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-66cf0537-f687-4f03-be2e-17de3250ad15 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:39.649668 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-66cf0537-f687-4f03-be2e-17de3250ad15 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] [instance: 239cbe4b-b0d1-4361-80af-f3015cb39176] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:39.656093 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-66cf0537-f687-4f03-be2e-17de3250ad15 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:39.656575 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-66cf0537-f687-4f03-be2e-17de3250ad15 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:39.657007 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-66cf0537-f687-4f03-be2e-17de3250ad15 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:39.657689 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-66cf0537-f687-4f03-be2e-17de3250ad15 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:39.658141 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-66cf0537-f687-4f03-be2e-17de3250ad15 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:39.658562 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-66cf0537-f687-4f03-be2e-17de3250ad15 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:39.672259 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.wsgi [None req-66cf0537-f687-4f03-be2e-17de3250ad15 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] HTTP exception thrown: Instance 239cbe4b-b0d1-4361-80af-f3015cb39176 could not be found. Oct 28 09:59:39.673771 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-66cf0537-f687-4f03-be2e-17de3250ad15 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Request method failure captured: Oct 28 09:59:39.673771 dv-cinder-zed-3-smb devstack@n-api.service[127033]: request: GET /compute/v2.1/servers/239cbe4b-b0d1-4361-80af-f3015cb39176 HTTP/1.1 Oct 28 09:59:39.673771 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Accept: application/json Oct 28 09:59:39.673771 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Accept-Encoding: identity Oct 28 09:59:39.673771 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Connection: close Oct 28 09:59:39.673771 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Content-Length: 0 Oct 28 09:59:39.673771 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Content-Type: application/json Oct 28 09:59:39.673771 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Host: 10.222.0.52 Oct 28 09:59:39.673771 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Openstack-System-Scope: None Oct 28 09:59:39.673771 dv-cinder-zed-3-smb devstack@n-api.service[127033]: User-Agent: python-urllib3/1.26.12 Oct 28 09:59:39.673771 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Auth-Token: gAAAAABjW6ZlB_y8UlHttqFpTZf-FQqNFL8UpqBADpRqoMnMvW_jAoL6f5CF8d3TJuqshSrx4zOxOgPBQaaPIBzA2l5d4VliO6WO9dxAWAz2QeafoRTcYtg1CKFv-cJOUbVbMelTlyaihpwFtFOGoW8EkNwvlaaR3DGtxA3ButWLQbGRra0UmvI Oct 28 09:59:39.673771 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Domain-Id: None Oct 28 09:59:39.673771 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Domain-Name: None Oct 28 09:59:39.673771 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Identity-Status: Confirmed Oct 28 09:59:39.673771 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Is-Admin-Project: True Oct 28 09:59:39.673771 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Project-Domain-Id: default Oct 28 09:59:39.673771 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Project-Domain-Name: Default Oct 28 09:59:39.673771 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Project-Id: 68e60d7c624e49e1bb43188ae9d7dd2b Oct 28 09:59:39.673771 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Project-Name: tempest-AttachVolumeNegativeTest-21111899 Oct 28 09:59:39.673771 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Role: reader,member Oct 28 09:59:39.673771 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Roles: reader,member Oct 28 09:59:39.675373 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_68e60d7c624e49e1bb43188ae9d7dd2b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/68e60d7c624e49e1bb43188ae9d7dd2b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/68e60d7c624e49e1bb43188ae9d7dd2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/68e60d7c624e49e1bb43188ae9d7dd2b"}]}] Oct 28 09:59:39.675373 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Tenant: tempest-AttachVolumeNegativeTest-21111899 Oct 28 09:59:39.675373 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Tenant-Id: 68e60d7c624e49e1bb43188ae9d7dd2b Oct 28 09:59:39.675373 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-21111899 Oct 28 09:59:39.675373 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User: tempest-AttachVolumeNegativeTest-21111899-project Oct 28 09:59:39.675373 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User-Domain-Id: default Oct 28 09:59:39.675373 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User-Domain-Name: Default Oct 28 09:59:39.675373 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User-Id: d38ce75423b5412d90c1158396978b97 Oct 28 09:59:39.675373 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User-Name: tempest-AttachVolumeNegativeTest-21111899-project Oct 28 09:59:39.675373 dv-cinder-zed-3-smb devstack@n-api.service[127033]: method: > Oct 28 09:59:39.675373 dv-cinder-zed-3-smb devstack@n-api.service[127033]: exception: Instance 239cbe4b-b0d1-4361-80af-f3015cb39176 could not be found. Oct 28 09:59:39.675373 dv-cinder-zed-3-smb devstack@n-api.service[127033]: action_args: {'id': '239cbe4b-b0d1-4361-80af-f3015cb39176'} Oct 28 09:59:39.676978 dv-cinder-zed-3-smb devstack@n-api.service[127033]: {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:59:39.676978 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:59:39.676978 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 09:59:39.676978 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 09:59:39.676978 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 09:59:39.676978 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 09:59:39.676978 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 09:59:39.676978 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 09:59:39.676978 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 09:59:39.676978 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 09:59:39.676978 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 239cbe4b-b0d1-4361-80af-f3015cb39176 could not be found. Oct 28 09:59:39.676978 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:59:39.676978 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:59:39.676978 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:59:39.676978 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:59:39.676978 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:59:39.676978 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:59:39.676978 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:59:39.676978 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:59:39.676978 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:59:39.678531 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:59:39.678531 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 09:59:39.678531 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 09:59:39.678531 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 09:59:39.678531 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 09:59:39.678531 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 09:59:39.678531 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 09:59:39.678531 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 239cbe4b-b0d1-4361-80af-f3015cb39176 could not be found. Oct 28 09:59:39.678531 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:59:39.678531 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:59:39.678531 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:59:39.678531 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:59:39.678531 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:59:39.678531 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:59:39.678531 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:59:39.678531 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:59:39.678531 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 239cbe4b-b0d1-4361-80af-f3015cb39176 could not be found. Oct 28 09:59:39.678531 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:59:39.679974 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-66cf0537-f687-4f03-be2e-17de3250ad15 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] Returning 404 to user: Instance 239cbe4b-b0d1-4361-80af-f3015cb39176 could not be found. {{(pid=127033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:59:39.679974 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-66cf0537-f687-4f03-be2e-17de3250ad15 tempest-AttachVolumeNegativeTest-21111899 tempest-AttachVolumeNegativeTest-21111899-project] 10.222.0.52 "GET /compute/v2.1/servers/239cbe4b-b0d1-4361-80af-f3015cb39176" status: 404 len: 111 microversion: 2.1 time: 0.029938 Oct 28 09:59:39.679974 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 489/997] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 09:59:39 2022] GET /compute/v2.1/servers/239cbe4b-b0d1-4361-80af-f3015cb39176 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:59:43.738253 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-e09ce6cd-98ef-4fb8-89db-5f88ec790789 tempest-VolumesSnapshotsTestJSON-933147594 tempest-VolumesSnapshotsTestJSON-933147594-project] Action: 'create', calling method: .version_select at 0x7ff0102094c0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1878439140"}} {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:59:44.034967 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-e09ce6cd-98ef-4fb8-89db-5f88ec790789 tempest-VolumesSnapshotsTestJSON-933147594 tempest-VolumesSnapshotsTestJSON-933147594-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.409836 Oct 28 09:59:44.035718 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 509/998] 10.222.0.52 () {60 vars in 1155 bytes} [Fri Oct 28 09:59:43 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 411 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 28 09:59:44.048972 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-d8be9bd0-1503-4694-9244-3e479269185a tempest-VolumesSnapshotsTestJSON-933147594 tempest-VolumesSnapshotsTestJSON-933147594-project] Calling method '.version_select at 0x7ff01011d670>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:44.102606 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-d8be9bd0-1503-4694-9244-3e479269185a tempest-VolumesSnapshotsTestJSON-933147594 tempest-VolumesSnapshotsTestJSON-933147594-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/7a2cbe83-ceac-42d2-b900-28cfc410a41e" status: 200 len: 345 microversion: 2.1 time: 0.057395 Oct 28 09:59:44.103222 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 490/999] 10.222.0.52 () {58 vars in 1245 bytes} [Fri Oct 28 09:59:44 2022] GET /compute/v2.1/os-volumes/7a2cbe83-ceac-42d2-b900-28cfc410a41e => generated 345 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 09:59:45.118050 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-e63ce66c-425c-4996-bfbc-b03dc4ba0482 tempest-VolumesSnapshotsTestJSON-933147594 tempest-VolumesSnapshotsTestJSON-933147594-project] Calling method '.version_select at 0x7ff01029bd30>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:45.166321 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-e63ce66c-425c-4996-bfbc-b03dc4ba0482 tempest-VolumesSnapshotsTestJSON-933147594 tempest-VolumesSnapshotsTestJSON-933147594-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/7a2cbe83-ceac-42d2-b900-28cfc410a41e" status: 200 len: 346 microversion: 2.1 time: 0.052843 Oct 28 09:59:45.166983 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 510/1000] 10.222.0.52 () {58 vars in 1245 bytes} [Fri Oct 28 09:59:45 2022] GET /compute/v2.1/os-volumes/7a2cbe83-ceac-42d2-b900-28cfc410a41e => generated 346 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:59:45.180864 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-3621c847-7f3c-465b-9840-252e76379035 tempest-VolumesSnapshotsTestJSON-933147594 tempest-VolumesSnapshotsTestJSON-933147594-project] Action: 'create', calling method: .version_select at 0x7ff0100fb430>, body: {"snapshot": {"volume_id": "7a2cbe83-ceac-42d2-b900-28cfc410a41e", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-13538945"}} {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:59:45.331910 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-3621c847-7f3c-465b-9840-252e76379035 tempest-VolumesSnapshotsTestJSON-933147594 tempest-VolumesSnapshotsTestJSON-933147594-project] 10.222.0.52 "POST /compute/v2.1/os-snapshots" status: 200 len: 285 microversion: 2.1 time: 0.155250 Oct 28 09:59:45.332724 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 491/1001] 10.222.0.52 () {60 vars in 1162 bytes} [Fri Oct 28 09:59:45 2022] POST /compute/v2.1/os-snapshots => generated 285 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:59:45.343896 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-81fc852d-85b2-4afa-958e-f37c5e3ee768 tempest-VolumesSnapshotsTestJSON-933147594 tempest-VolumesSnapshotsTestJSON-933147594-project] Calling method '.version_select at 0x7ff0102e8c10>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:45.374046 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-81fc852d-85b2-4afa-958e-f37c5e3ee768 tempest-VolumesSnapshotsTestJSON-933147594 tempest-VolumesSnapshotsTestJSON-933147594-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/cffa3870-cc8f-4a3b-92f5-be29a9f89b9d" status: 200 len: 285 microversion: 2.1 time: 0.033907 Oct 28 09:59:45.374665 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 511/1002] 10.222.0.52 () {58 vars in 1251 bytes} [Fri Oct 28 09:59:45 2022] GET /compute/v2.1/os-snapshots/cffa3870-cc8f-4a3b-92f5-be29a9f89b9d => generated 285 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:59:45.386878 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-5f3df730-8a60-4222-a356-a82845adac14 tempest-VolumesSnapshotsTestJSON-933147594 tempest-VolumesSnapshotsTestJSON-933147594-project] Calling method '.version_select at 0x7ff0100dd3a0>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:45.417707 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-5f3df730-8a60-4222-a356-a82845adac14 tempest-VolumesSnapshotsTestJSON-933147594 tempest-VolumesSnapshotsTestJSON-933147594-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots" status: 200 len: 288 microversion: 2.1 time: 0.034701 Oct 28 09:59:45.418275 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 492/1003] 10.222.0.52 () {58 vars in 1140 bytes} [Fri Oct 28 09:59:45 2022] GET /compute/v2.1/os-snapshots => generated 288 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:59:45.429870 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-b0da1d51-8c91-42a1-b920-3cdf0dfeb329 tempest-VolumesSnapshotsTestJSON-933147594 tempest-VolumesSnapshotsTestJSON-933147594-project] Calling method '.version_select at 0x7ff010199280>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:45.460225 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-b0da1d51-8c91-42a1-b920-3cdf0dfeb329 tempest-VolumesSnapshotsTestJSON-933147594 tempest-VolumesSnapshotsTestJSON-933147594-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/cffa3870-cc8f-4a3b-92f5-be29a9f89b9d" status: 200 len: 285 microversion: 2.1 time: 0.034459 Oct 28 09:59:45.460896 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 512/1004] 10.222.0.52 () {58 vars in 1251 bytes} [Fri Oct 28 09:59:45 2022] GET /compute/v2.1/os-snapshots/cffa3870-cc8f-4a3b-92f5-be29a9f89b9d => generated 285 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:59:46.474038 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-8d4a5b75-7917-4f45-96cc-7b6546ae832d tempest-VolumesSnapshotsTestJSON-933147594 tempest-VolumesSnapshotsTestJSON-933147594-project] Calling method '.version_select at 0x7ff010183dc0>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:46.503521 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-8d4a5b75-7917-4f45-96cc-7b6546ae832d tempest-VolumesSnapshotsTestJSON-933147594 tempest-VolumesSnapshotsTestJSON-933147594-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/cffa3870-cc8f-4a3b-92f5-be29a9f89b9d" status: 200 len: 286 microversion: 2.1 time: 0.033716 Oct 28 09:59:46.504155 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 493/1005] 10.222.0.52 () {58 vars in 1251 bytes} [Fri Oct 28 09:59:46 2022] GET /compute/v2.1/os-snapshots/cffa3870-cc8f-4a3b-92f5-be29a9f89b9d => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:59:46.516664 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-09e1426f-4c9c-465d-86ef-1a1b286ca4dd tempest-VolumesSnapshotsTestJSON-933147594 tempest-VolumesSnapshotsTestJSON-933147594-project] Calling method '.version_select at 0x7ff013ae0160>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:46.574170 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-09e1426f-4c9c-465d-86ef-1a1b286ca4dd tempest-VolumesSnapshotsTestJSON-933147594 tempest-VolumesSnapshotsTestJSON-933147594-project] 10.222.0.52 "DELETE /compute/v2.1/os-snapshots/cffa3870-cc8f-4a3b-92f5-be29a9f89b9d" status: 202 len: 0 microversion: 2.1 time: 0.061732 Oct 28 09:59:46.574731 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 513/1006] 10.222.0.52 () {58 vars in 1254 bytes} [Fri Oct 28 09:59:46 2022] DELETE /compute/v2.1/os-snapshots/cffa3870-cc8f-4a3b-92f5-be29a9f89b9d => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:59:46.582929 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-b3355da7-9a20-4852-8265-f3fe6c8601a9 tempest-VolumesSnapshotsTestJSON-933147594 tempest-VolumesSnapshotsTestJSON-933147594-project] Calling method '.version_select at 0x7ff0101cae50>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:46.612806 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-b3355da7-9a20-4852-8265-f3fe6c8601a9 tempest-VolumesSnapshotsTestJSON-933147594 tempest-VolumesSnapshotsTestJSON-933147594-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/cffa3870-cc8f-4a3b-92f5-be29a9f89b9d" status: 200 len: 285 microversion: 2.1 time: 0.033718 Oct 28 09:59:46.613378 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 494/1007] 10.222.0.52 () {58 vars in 1251 bytes} [Fri Oct 28 09:59:46 2022] GET /compute/v2.1/os-snapshots/cffa3870-cc8f-4a3b-92f5-be29a9f89b9d => generated 285 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:59:47.626442 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-8abf66a8-7134-4947-993d-4a8da7855005 tempest-VolumesSnapshotsTestJSON-933147594 tempest-VolumesSnapshotsTestJSON-933147594-project] Calling method '.version_select at 0x7ff010209040>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:47.651443 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.wsgi [None req-8abf66a8-7134-4947-993d-4a8da7855005 tempest-VolumesSnapshotsTestJSON-933147594 tempest-VolumesSnapshotsTestJSON-933147594-project] HTTP exception thrown: Snapshot cffa3870-cc8f-4a3b-92f5-be29a9f89b9d could not be found. Oct 28 09:59:47.653697 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-8abf66a8-7134-4947-993d-4a8da7855005 tempest-VolumesSnapshotsTestJSON-933147594 tempest-VolumesSnapshotsTestJSON-933147594-project] Request method failure captured: Oct 28 09:59:47.653697 dv-cinder-zed-3-smb devstack@n-api.service[127032]: request: GET /compute/v2.1/os-snapshots/cffa3870-cc8f-4a3b-92f5-be29a9f89b9d HTTP/1.1 Oct 28 09:59:47.653697 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Accept: application/json Oct 28 09:59:47.653697 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Accept-Encoding: identity Oct 28 09:59:47.653697 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Connection: close Oct 28 09:59:47.653697 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Content-Length: 0 Oct 28 09:59:47.653697 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Content-Type: application/json Oct 28 09:59:47.653697 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Host: 10.222.0.52 Oct 28 09:59:47.653697 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Openstack-System-Scope: None Oct 28 09:59:47.653697 dv-cinder-zed-3-smb devstack@n-api.service[127032]: User-Agent: python-urllib3/1.26.12 Oct 28 09:59:47.653697 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Auth-Token: gAAAAABjW6gP-YbpqfmFZNXDahxrQukRywJOQfA_yreO-c7wjb5nNYcpHDczzB1dlb9iZwUaEF3XzWlttzoBSiSaDNNFuKxL3Yht0JiNW_h5UHyCgcNB46xE3mq61JsMTw3f7rR93czMP8sUBaQkQB6rfRg8w2iFhwi7U0f1UMLSxHewJ01aEkM Oct 28 09:59:47.653697 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Domain-Id: None Oct 28 09:59:47.653697 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Domain-Name: None Oct 28 09:59:47.653697 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Identity-Status: Confirmed Oct 28 09:59:47.653697 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Is-Admin-Project: True Oct 28 09:59:47.653697 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Project-Domain-Id: default Oct 28 09:59:47.653697 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Project-Domain-Name: Default Oct 28 09:59:47.653697 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Project-Id: 75f124edebb64b4191ec48450e1c272d Oct 28 09:59:47.653697 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-933147594 Oct 28 09:59:47.653697 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Role: reader,member Oct 28 09:59:47.653697 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Roles: reader,member Oct 28 09:59:47.655436 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_75f124edebb64b4191ec48450e1c272d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/75f124edebb64b4191ec48450e1c272d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/75f124edebb64b4191ec48450e1c272d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/75f124edebb64b4191ec48450e1c272d"}]}] Oct 28 09:59:47.655436 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Tenant: tempest-VolumesSnapshotsTestJSON-933147594 Oct 28 09:59:47.655436 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Tenant-Id: 75f124edebb64b4191ec48450e1c272d Oct 28 09:59:47.655436 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-933147594 Oct 28 09:59:47.655436 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-User: tempest-VolumesSnapshotsTestJSON-933147594-project Oct 28 09:59:47.655436 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-User-Domain-Id: default Oct 28 09:59:47.655436 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-User-Domain-Name: Default Oct 28 09:59:47.655436 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-User-Id: bede338290734621b054afe6eba59ad3 Oct 28 09:59:47.655436 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-User-Name: tempest-VolumesSnapshotsTestJSON-933147594-project Oct 28 09:59:47.655436 dv-cinder-zed-3-smb devstack@n-api.service[127032]: method: Oct 28 09:59:47.655436 dv-cinder-zed-3-smb devstack@n-api.service[127032]: exception: Snapshot cffa3870-cc8f-4a3b-92f5-be29a9f89b9d could not be found. Oct 28 09:59:47.655436 dv-cinder-zed-3-smb devstack@n-api.service[127032]: action_args: {'id': 'cffa3870-cc8f-4a3b-92f5-be29a9f89b9d'} Oct 28 09:59:47.655436 dv-cinder-zed-3-smb devstack@n-api.service[127032]: {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:59:47.656771 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:59:47.656771 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 28 09:59:47.656771 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 28 09:59:47.656771 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 28 09:59:47.656771 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 28 09:59:47.656771 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 28 09:59:47.656771 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 28 09:59:47.656771 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 28 09:59:47.656771 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 28 09:59:47.656771 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 28 09:59:47.656771 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 28 09:59:47.656771 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 28 09:59:47.656771 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 28 09:59:47.656771 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 28 09:59:47.656771 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 28 09:59:47.656771 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot cffa3870-cc8f-4a3b-92f5-be29a9f89b9d could not be found. (HTTP 404) (Request-ID: req-c644bde4-37ca-42e7-8615-2b9922b71e83) Oct 28 09:59:47.656771 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Oct 28 09:59:47.656771 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:59:47.658170 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Oct 28 09:59:47.658170 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:59:47.658170 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Oct 28 09:59:47.658170 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Oct 28 09:59:47.658170 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 28 09:59:47.658170 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 28 09:59:47.658170 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Oct 28 09:59:47.658170 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Oct 28 09:59:47.658170 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 28 09:59:47.658170 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 28 09:59:47.658170 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 28 09:59:47.658170 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 28 09:59:47.658170 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 28 09:59:47.658170 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 28 09:59:47.658170 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 28 09:59:47.658170 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 28 09:59:47.658170 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 28 09:59:47.658170 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 28 09:59:47.658170 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 28 09:59:47.659720 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 28 09:59:47.659720 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 28 09:59:47.659720 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 28 09:59:47.659720 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 28 09:59:47.659720 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 28 09:59:47.659720 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot cffa3870-cc8f-4a3b-92f5-be29a9f89b9d could not be found. Oct 28 09:59:47.659720 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Oct 28 09:59:47.659720 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:59:47.659720 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Oct 28 09:59:47.659720 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:59:47.659720 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:59:47.659720 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:59:47.659720 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:59:47.659720 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:59:47.659720 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 09:59:47.659720 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 09:59:47.659720 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:59:47.659720 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:59:47.659720 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Oct 28 09:59:47.659720 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 09:59:47.661270 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot cffa3870-cc8f-4a3b-92f5-be29a9f89b9d could not be found. Oct 28 09:59:47.661270 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Oct 28 09:59:47.661270 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:59:47.661270 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Oct 28 09:59:47.661270 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:59:47.661270 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:59:47.661270 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:59:47.661270 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:59:47.661270 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:59:47.661270 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot cffa3870-cc8f-4a3b-92f5-be29a9f89b9d could not be found. Oct 28 09:59:47.661270 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Oct 28 09:59:47.661270 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-8abf66a8-7134-4947-993d-4a8da7855005 tempest-VolumesSnapshotsTestJSON-933147594 tempest-VolumesSnapshotsTestJSON-933147594-project] Returning 404 to user: Snapshot cffa3870-cc8f-4a3b-92f5-be29a9f89b9d could not be found. {{(pid=127032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:59:47.661270 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-8abf66a8-7134-4947-993d-4a8da7855005 tempest-VolumesSnapshotsTestJSON-933147594 tempest-VolumesSnapshotsTestJSON-933147594-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/cffa3870-cc8f-4a3b-92f5-be29a9f89b9d" status: 404 len: 111 microversion: 2.1 time: 0.033296 Oct 28 09:59:47.662252 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 514/1008] 10.222.0.52 () {58 vars in 1251 bytes} [Fri Oct 28 09:59:47 2022] GET /compute/v2.1/os-snapshots/cffa3870-cc8f-4a3b-92f5-be29a9f89b9d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:59:47.664274 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-8f292c62-1365-4848-bf9c-ad1ddad9d748 tempest-VolumesSnapshotsTestJSON-933147594 tempest-VolumesSnapshotsTestJSON-933147594-project] Calling method '.version_select at 0x7ff010142f70>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:47.725372 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-8f292c62-1365-4848-bf9c-ad1ddad9d748 tempest-VolumesSnapshotsTestJSON-933147594 tempest-VolumesSnapshotsTestJSON-933147594-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/7a2cbe83-ceac-42d2-b900-28cfc410a41e" status: 202 len: 0 microversion: 2.1 time: 0.065390 Oct 28 09:59:47.725929 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 495/1009] 10.222.0.52 () {58 vars in 1248 bytes} [Fri Oct 28 09:59:47 2022] DELETE /compute/v2.1/os-volumes/7a2cbe83-ceac-42d2-b900-28cfc410a41e => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:59:47.734436 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-8aca233e-7d9a-4004-9f1c-8b5288ba0c60 tempest-VolumesSnapshotsTestJSON-933147594 tempest-VolumesSnapshotsTestJSON-933147594-project] Calling method '.version_select at 0x7ff0101165e0>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:47.783011 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-8aca233e-7d9a-4004-9f1c-8b5288ba0c60 tempest-VolumesSnapshotsTestJSON-933147594 tempest-VolumesSnapshotsTestJSON-933147594-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/7a2cbe83-ceac-42d2-b900-28cfc410a41e" status: 200 len: 345 microversion: 2.1 time: 0.052738 Oct 28 09:59:47.783567 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 515/1010] 10.222.0.52 () {58 vars in 1245 bytes} [Fri Oct 28 09:59:47 2022] GET /compute/v2.1/os-volumes/7a2cbe83-ceac-42d2-b900-28cfc410a41e => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:59:48.798406 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-60365664-2200-4eb2-9acd-0bc979aad46e tempest-VolumesSnapshotsTestJSON-933147594 tempest-VolumesSnapshotsTestJSON-933147594-project] Calling method '.version_select at 0x7ff0100dd4c0>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:48.826876 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.wsgi [None req-60365664-2200-4eb2-9acd-0bc979aad46e tempest-VolumesSnapshotsTestJSON-933147594 tempest-VolumesSnapshotsTestJSON-933147594-project] HTTP exception thrown: Volume 7a2cbe83-ceac-42d2-b900-28cfc410a41e could not be found. Oct 28 09:59:48.828882 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-60365664-2200-4eb2-9acd-0bc979aad46e tempest-VolumesSnapshotsTestJSON-933147594 tempest-VolumesSnapshotsTestJSON-933147594-project] Request method failure captured: Oct 28 09:59:48.828882 dv-cinder-zed-3-smb devstack@n-api.service[127033]: request: GET /compute/v2.1/os-volumes/7a2cbe83-ceac-42d2-b900-28cfc410a41e HTTP/1.1 Oct 28 09:59:48.828882 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Accept: application/json Oct 28 09:59:48.828882 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Accept-Encoding: identity Oct 28 09:59:48.828882 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Connection: close Oct 28 09:59:48.828882 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Content-Length: 0 Oct 28 09:59:48.828882 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Content-Type: application/json Oct 28 09:59:48.828882 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Host: 10.222.0.52 Oct 28 09:59:48.828882 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Openstack-System-Scope: None Oct 28 09:59:48.828882 dv-cinder-zed-3-smb devstack@n-api.service[127033]: User-Agent: python-urllib3/1.26.12 Oct 28 09:59:48.828882 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Auth-Token: gAAAAABjW6gP-YbpqfmFZNXDahxrQukRywJOQfA_yreO-c7wjb5nNYcpHDczzB1dlb9iZwUaEF3XzWlttzoBSiSaDNNFuKxL3Yht0JiNW_h5UHyCgcNB46xE3mq61JsMTw3f7rR93czMP8sUBaQkQB6rfRg8w2iFhwi7U0f1UMLSxHewJ01aEkM Oct 28 09:59:48.828882 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Domain-Id: None Oct 28 09:59:48.828882 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Domain-Name: None Oct 28 09:59:48.828882 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Identity-Status: Confirmed Oct 28 09:59:48.828882 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Is-Admin-Project: True Oct 28 09:59:48.828882 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Project-Domain-Id: default Oct 28 09:59:48.828882 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Project-Domain-Name: Default Oct 28 09:59:48.828882 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Project-Id: 75f124edebb64b4191ec48450e1c272d Oct 28 09:59:48.828882 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-933147594 Oct 28 09:59:48.828882 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Role: reader,member Oct 28 09:59:48.828882 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Roles: reader,member Oct 28 09:59:48.830865 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_75f124edebb64b4191ec48450e1c272d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/75f124edebb64b4191ec48450e1c272d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/75f124edebb64b4191ec48450e1c272d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/75f124edebb64b4191ec48450e1c272d"}]}] Oct 28 09:59:48.830865 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Tenant: tempest-VolumesSnapshotsTestJSON-933147594 Oct 28 09:59:48.830865 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Tenant-Id: 75f124edebb64b4191ec48450e1c272d Oct 28 09:59:48.830865 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-933147594 Oct 28 09:59:48.830865 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User: tempest-VolumesSnapshotsTestJSON-933147594-project Oct 28 09:59:48.830865 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User-Domain-Id: default Oct 28 09:59:48.830865 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User-Domain-Name: Default Oct 28 09:59:48.830865 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User-Id: bede338290734621b054afe6eba59ad3 Oct 28 09:59:48.830865 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User-Name: tempest-VolumesSnapshotsTestJSON-933147594-project Oct 28 09:59:48.830865 dv-cinder-zed-3-smb devstack@n-api.service[127033]: method: Oct 28 09:59:48.830865 dv-cinder-zed-3-smb devstack@n-api.service[127033]: exception: Volume 7a2cbe83-ceac-42d2-b900-28cfc410a41e could not be found. Oct 28 09:59:48.830865 dv-cinder-zed-3-smb devstack@n-api.service[127033]: action_args: {'id': '7a2cbe83-ceac-42d2-b900-28cfc410a41e'} Oct 28 09:59:48.830865 dv-cinder-zed-3-smb devstack@n-api.service[127033]: {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:59:48.831923 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:59:48.831923 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 28 09:59:48.831923 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 28 09:59:48.831923 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 28 09:59:48.831923 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 28 09:59:48.831923 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 28 09:59:48.831923 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 28 09:59:48.831923 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 28 09:59:48.831923 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 28 09:59:48.831923 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 28 09:59:48.831923 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 28 09:59:48.831923 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 28 09:59:48.831923 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 28 09:59:48.831923 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 28 09:59:48.831923 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 28 09:59:48.831923 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7a2cbe83-ceac-42d2-b900-28cfc410a41e could not be found. (HTTP 404) (Request-ID: req-ae8f4919-9ff2-4b39-bf82-d26127754e91) Oct 28 09:59:48.831923 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:59:48.831923 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:59:48.831923 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:59:48.834219 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:59:48.834219 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 28 09:59:48.834219 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 28 09:59:48.834219 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 28 09:59:48.834219 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 28 09:59:48.834219 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 28 09:59:48.834219 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 28 09:59:48.834219 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 28 09:59:48.834219 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 28 09:59:48.834219 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 28 09:59:48.834219 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 28 09:59:48.834219 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 28 09:59:48.834219 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 28 09:59:48.834219 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 28 09:59:48.834219 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 28 09:59:48.834219 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 28 09:59:48.834219 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 28 09:59:48.834219 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 28 09:59:48.834219 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 28 09:59:48.835931 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 28 09:59:48.835931 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 28 09:59:48.835931 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 28 09:59:48.835931 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 28 09:59:48.835931 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7a2cbe83-ceac-42d2-b900-28cfc410a41e could not be found. Oct 28 09:59:48.835931 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:59:48.835931 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:59:48.835931 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:59:48.835931 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:59:48.835931 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:59:48.835931 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:59:48.835931 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:59:48.835931 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:59:48.835931 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 09:59:48.835931 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 09:59:48.835931 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:59:48.835931 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:59:48.835931 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 28 09:59:48.835931 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 09:59:48.837716 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7a2cbe83-ceac-42d2-b900-28cfc410a41e could not be found. Oct 28 09:59:48.837716 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:59:48.837716 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:59:48.837716 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:59:48.837716 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:59:48.837716 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:59:48.837716 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:59:48.837716 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:59:48.837716 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:59:48.837716 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7a2cbe83-ceac-42d2-b900-28cfc410a41e could not be found. Oct 28 09:59:48.837716 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:59:48.837716 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-60365664-2200-4eb2-9acd-0bc979aad46e tempest-VolumesSnapshotsTestJSON-933147594 tempest-VolumesSnapshotsTestJSON-933147594-project] Returning 404 to user: Volume 7a2cbe83-ceac-42d2-b900-28cfc410a41e could not be found. {{(pid=127033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:59:48.837716 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-60365664-2200-4eb2-9acd-0bc979aad46e tempest-VolumesSnapshotsTestJSON-933147594 tempest-VolumesSnapshotsTestJSON-933147594-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/7a2cbe83-ceac-42d2-b900-28cfc410a41e" status: 404 len: 109 microversion: 2.1 time: 0.036362 Oct 28 09:59:48.837716 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 496/1011] 10.222.0.52 () {58 vars in 1245 bytes} [Fri Oct 28 09:59:48 2022] GET /compute/v2.1/os-volumes/7a2cbe83-ceac-42d2-b900-28cfc410a41e => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:59:48.847045 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-d23b1818-89da-4435-b514-2bcf482e9b8e tempest-VolumesSnapshotsTestJSON-933147594 tempest-VolumesSnapshotsTestJSON-933147594-project] Calling method '.version_select at 0x7ff0102094c0>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:48.875264 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.wsgi [None req-d23b1818-89da-4435-b514-2bcf482e9b8e tempest-VolumesSnapshotsTestJSON-933147594 tempest-VolumesSnapshotsTestJSON-933147594-project] HTTP exception thrown: Volume 7a2cbe83-ceac-42d2-b900-28cfc410a41e could not be found. Oct 28 09:59:48.877528 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-d23b1818-89da-4435-b514-2bcf482e9b8e tempest-VolumesSnapshotsTestJSON-933147594 tempest-VolumesSnapshotsTestJSON-933147594-project] Request method failure captured: Oct 28 09:59:48.877528 dv-cinder-zed-3-smb devstack@n-api.service[127032]: request: DELETE /compute/v2.1/os-volumes/7a2cbe83-ceac-42d2-b900-28cfc410a41e HTTP/1.1 Oct 28 09:59:48.877528 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Accept: application/json Oct 28 09:59:48.877528 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Accept-Encoding: identity Oct 28 09:59:48.877528 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Connection: close Oct 28 09:59:48.877528 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Content-Length: 0 Oct 28 09:59:48.877528 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Content-Type: application/json Oct 28 09:59:48.877528 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Host: 10.222.0.52 Oct 28 09:59:48.877528 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Openstack-System-Scope: None Oct 28 09:59:48.877528 dv-cinder-zed-3-smb devstack@n-api.service[127032]: User-Agent: python-urllib3/1.26.12 Oct 28 09:59:48.877528 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Auth-Token: gAAAAABjW6gP-YbpqfmFZNXDahxrQukRywJOQfA_yreO-c7wjb5nNYcpHDczzB1dlb9iZwUaEF3XzWlttzoBSiSaDNNFuKxL3Yht0JiNW_h5UHyCgcNB46xE3mq61JsMTw3f7rR93czMP8sUBaQkQB6rfRg8w2iFhwi7U0f1UMLSxHewJ01aEkM Oct 28 09:59:48.877528 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Domain-Id: None Oct 28 09:59:48.877528 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Domain-Name: None Oct 28 09:59:48.877528 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Identity-Status: Confirmed Oct 28 09:59:48.877528 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Is-Admin-Project: True Oct 28 09:59:48.877528 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Project-Domain-Id: default Oct 28 09:59:48.877528 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Project-Domain-Name: Default Oct 28 09:59:48.877528 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Project-Id: 75f124edebb64b4191ec48450e1c272d Oct 28 09:59:48.877528 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-933147594 Oct 28 09:59:48.877528 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Role: reader,member Oct 28 09:59:48.877528 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Roles: reader,member Oct 28 09:59:48.879188 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_75f124edebb64b4191ec48450e1c272d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/75f124edebb64b4191ec48450e1c272d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/75f124edebb64b4191ec48450e1c272d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/75f124edebb64b4191ec48450e1c272d"}]}] Oct 28 09:59:48.879188 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Tenant: tempest-VolumesSnapshotsTestJSON-933147594 Oct 28 09:59:48.879188 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Tenant-Id: 75f124edebb64b4191ec48450e1c272d Oct 28 09:59:48.879188 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-933147594 Oct 28 09:59:48.879188 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-User: tempest-VolumesSnapshotsTestJSON-933147594-project Oct 28 09:59:48.879188 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-User-Domain-Id: default Oct 28 09:59:48.879188 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-User-Domain-Name: Default Oct 28 09:59:48.879188 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-User-Id: bede338290734621b054afe6eba59ad3 Oct 28 09:59:48.879188 dv-cinder-zed-3-smb devstack@n-api.service[127032]: X-User-Name: tempest-VolumesSnapshotsTestJSON-933147594-project Oct 28 09:59:48.879188 dv-cinder-zed-3-smb devstack@n-api.service[127032]: method: Oct 28 09:59:48.879188 dv-cinder-zed-3-smb devstack@n-api.service[127032]: exception: Volume 7a2cbe83-ceac-42d2-b900-28cfc410a41e could not be found. Oct 28 09:59:48.879188 dv-cinder-zed-3-smb devstack@n-api.service[127032]: action_args: {'id': '7a2cbe83-ceac-42d2-b900-28cfc410a41e'} Oct 28 09:59:48.879188 dv-cinder-zed-3-smb devstack@n-api.service[127032]: {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:59:48.880056 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:59:48.880056 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 28 09:59:48.880056 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 28 09:59:48.880056 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 28 09:59:48.880056 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 28 09:59:48.880056 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 28 09:59:48.880056 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 28 09:59:48.880056 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 28 09:59:48.880056 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 28 09:59:48.880056 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 28 09:59:48.880056 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 28 09:59:48.880056 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 28 09:59:48.880056 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 28 09:59:48.880056 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 28 09:59:48.880056 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 28 09:59:48.880056 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7a2cbe83-ceac-42d2-b900-28cfc410a41e could not be found. (HTTP 404) (Request-ID: req-7c334911-0bfe-42fa-be9c-4f90578aafde) Oct 28 09:59:48.880056 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Oct 28 09:59:48.880056 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:59:48.880056 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Oct 28 09:59:48.881766 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:59:48.881766 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 28 09:59:48.881766 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 28 09:59:48.881766 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 28 09:59:48.881766 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 28 09:59:48.881766 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 28 09:59:48.881766 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 28 09:59:48.881766 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 28 09:59:48.881766 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 28 09:59:48.881766 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 28 09:59:48.881766 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 28 09:59:48.881766 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 28 09:59:48.881766 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 28 09:59:48.881766 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 28 09:59:48.881766 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 28 09:59:48.881766 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 28 09:59:48.881766 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 28 09:59:48.881766 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 28 09:59:48.881766 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 28 09:59:48.883122 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 28 09:59:48.883122 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 28 09:59:48.883122 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 28 09:59:48.883122 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 28 09:59:48.883122 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7a2cbe83-ceac-42d2-b900-28cfc410a41e could not be found. Oct 28 09:59:48.883122 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Oct 28 09:59:48.883122 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:59:48.883122 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Oct 28 09:59:48.883122 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:59:48.883122 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:59:48.883122 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:59:48.883122 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:59:48.883122 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:59:48.883122 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 09:59:48.883122 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 09:59:48.883122 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:59:48.883122 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:59:48.883122 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 28 09:59:48.883122 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 09:59:48.884677 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7a2cbe83-ceac-42d2-b900-28cfc410a41e could not be found. Oct 28 09:59:48.884677 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Oct 28 09:59:48.884677 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:59:48.884677 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Oct 28 09:59:48.884677 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:59:48.884677 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:59:48.884677 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:59:48.884677 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:59:48.884677 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:59:48.884677 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7a2cbe83-ceac-42d2-b900-28cfc410a41e could not be found. Oct 28 09:59:48.884677 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR nova.api.openstack.wsgi Oct 28 09:59:48.884677 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-d23b1818-89da-4435-b514-2bcf482e9b8e tempest-VolumesSnapshotsTestJSON-933147594 tempest-VolumesSnapshotsTestJSON-933147594-project] Returning 404 to user: Volume 7a2cbe83-ceac-42d2-b900-28cfc410a41e could not be found. {{(pid=127032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:59:48.884677 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-d23b1818-89da-4435-b514-2bcf482e9b8e tempest-VolumesSnapshotsTestJSON-933147594 tempest-VolumesSnapshotsTestJSON-933147594-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/7a2cbe83-ceac-42d2-b900-28cfc410a41e" status: 404 len: 109 microversion: 2.1 time: 0.036309 Oct 28 09:59:48.884677 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 516/1012] 10.222.0.52 () {58 vars in 1248 bytes} [Fri Oct 28 09:59:48 2022] DELETE /compute/v2.1/os-volumes/7a2cbe83-ceac-42d2-b900-28cfc410a41e => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:59:48.889156 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-e4068030-0571-4f33-9309-4843bf41d2b4 tempest-VolumesSnapshotsTestJSON-933147594 tempest-VolumesSnapshotsTestJSON-933147594-project] Calling method '.version_select at 0x7ff013b2ec10>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:48.916802 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.wsgi [None req-e4068030-0571-4f33-9309-4843bf41d2b4 tempest-VolumesSnapshotsTestJSON-933147594 tempest-VolumesSnapshotsTestJSON-933147594-project] HTTP exception thrown: Volume 7a2cbe83-ceac-42d2-b900-28cfc410a41e could not be found. Oct 28 09:59:48.918801 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-e4068030-0571-4f33-9309-4843bf41d2b4 tempest-VolumesSnapshotsTestJSON-933147594 tempest-VolumesSnapshotsTestJSON-933147594-project] Request method failure captured: Oct 28 09:59:48.918801 dv-cinder-zed-3-smb devstack@n-api.service[127033]: request: GET /compute/v2.1/os-volumes/7a2cbe83-ceac-42d2-b900-28cfc410a41e HTTP/1.1 Oct 28 09:59:48.918801 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Accept: application/json Oct 28 09:59:48.918801 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Accept-Encoding: identity Oct 28 09:59:48.918801 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Connection: close Oct 28 09:59:48.918801 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Content-Length: 0 Oct 28 09:59:48.918801 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Content-Type: application/json Oct 28 09:59:48.918801 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Host: 10.222.0.52 Oct 28 09:59:48.918801 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Openstack-System-Scope: None Oct 28 09:59:48.918801 dv-cinder-zed-3-smb devstack@n-api.service[127033]: User-Agent: python-urllib3/1.26.12 Oct 28 09:59:48.918801 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Auth-Token: gAAAAABjW6gP-YbpqfmFZNXDahxrQukRywJOQfA_yreO-c7wjb5nNYcpHDczzB1dlb9iZwUaEF3XzWlttzoBSiSaDNNFuKxL3Yht0JiNW_h5UHyCgcNB46xE3mq61JsMTw3f7rR93czMP8sUBaQkQB6rfRg8w2iFhwi7U0f1UMLSxHewJ01aEkM Oct 28 09:59:48.918801 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Domain-Id: None Oct 28 09:59:48.918801 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Domain-Name: None Oct 28 09:59:48.918801 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Identity-Status: Confirmed Oct 28 09:59:48.918801 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Is-Admin-Project: True Oct 28 09:59:48.918801 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Project-Domain-Id: default Oct 28 09:59:48.918801 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Project-Domain-Name: Default Oct 28 09:59:48.918801 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Project-Id: 75f124edebb64b4191ec48450e1c272d Oct 28 09:59:48.918801 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-933147594 Oct 28 09:59:48.918801 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Role: reader,member Oct 28 09:59:48.918801 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Roles: reader,member Oct 28 09:59:48.920561 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_75f124edebb64b4191ec48450e1c272d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/75f124edebb64b4191ec48450e1c272d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/75f124edebb64b4191ec48450e1c272d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/75f124edebb64b4191ec48450e1c272d"}]}] Oct 28 09:59:48.920561 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Tenant: tempest-VolumesSnapshotsTestJSON-933147594 Oct 28 09:59:48.920561 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Tenant-Id: 75f124edebb64b4191ec48450e1c272d Oct 28 09:59:48.920561 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-933147594 Oct 28 09:59:48.920561 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User: tempest-VolumesSnapshotsTestJSON-933147594-project Oct 28 09:59:48.920561 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User-Domain-Id: default Oct 28 09:59:48.920561 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User-Domain-Name: Default Oct 28 09:59:48.920561 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User-Id: bede338290734621b054afe6eba59ad3 Oct 28 09:59:48.920561 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User-Name: tempest-VolumesSnapshotsTestJSON-933147594-project Oct 28 09:59:48.920561 dv-cinder-zed-3-smb devstack@n-api.service[127033]: method: Oct 28 09:59:48.920561 dv-cinder-zed-3-smb devstack@n-api.service[127033]: exception: Volume 7a2cbe83-ceac-42d2-b900-28cfc410a41e could not be found. Oct 28 09:59:48.920561 dv-cinder-zed-3-smb devstack@n-api.service[127033]: action_args: {'id': '7a2cbe83-ceac-42d2-b900-28cfc410a41e'} Oct 28 09:59:48.920561 dv-cinder-zed-3-smb devstack@n-api.service[127033]: {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:59:48.921579 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:59:48.921579 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 28 09:59:48.921579 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 28 09:59:48.921579 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 28 09:59:48.921579 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 28 09:59:48.921579 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 28 09:59:48.921579 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 28 09:59:48.921579 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 28 09:59:48.921579 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 28 09:59:48.921579 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 28 09:59:48.921579 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 28 09:59:48.921579 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 28 09:59:48.921579 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 28 09:59:48.921579 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 28 09:59:48.921579 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 28 09:59:48.921579 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7a2cbe83-ceac-42d2-b900-28cfc410a41e could not be found. (HTTP 404) (Request-ID: req-91081c4a-64b1-47c0-b0d6-dce840f717df) Oct 28 09:59:48.921579 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:59:48.921579 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:59:48.921579 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:59:48.923017 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:59:48.923017 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 28 09:59:48.923017 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 28 09:59:48.923017 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 28 09:59:48.923017 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 28 09:59:48.923017 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 28 09:59:48.923017 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 28 09:59:48.923017 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 28 09:59:48.923017 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 28 09:59:48.923017 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 28 09:59:48.923017 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 28 09:59:48.923017 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 28 09:59:48.923017 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 28 09:59:48.923017 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 28 09:59:48.923017 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 28 09:59:48.923017 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 28 09:59:48.923017 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 28 09:59:48.923017 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 28 09:59:48.923017 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 28 09:59:48.924471 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 28 09:59:48.924471 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 28 09:59:48.924471 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 28 09:59:48.924471 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 28 09:59:48.924471 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7a2cbe83-ceac-42d2-b900-28cfc410a41e could not be found. Oct 28 09:59:48.924471 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:59:48.924471 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:59:48.924471 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:59:48.924471 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:59:48.924471 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:59:48.924471 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:59:48.924471 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:59:48.924471 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:59:48.924471 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 09:59:48.924471 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 09:59:48.924471 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:59:48.924471 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:59:48.924471 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 28 09:59:48.924471 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 09:59:48.925853 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7a2cbe83-ceac-42d2-b900-28cfc410a41e could not be found. Oct 28 09:59:48.925853 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:59:48.925853 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:59:48.925853 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:59:48.925853 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:59:48.925853 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:59:48.925853 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:59:48.925853 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:59:48.925853 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:59:48.925853 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7a2cbe83-ceac-42d2-b900-28cfc410a41e could not be found. Oct 28 09:59:48.925853 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 09:59:48.925853 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-e4068030-0571-4f33-9309-4843bf41d2b4 tempest-VolumesSnapshotsTestJSON-933147594 tempest-VolumesSnapshotsTestJSON-933147594-project] Returning 404 to user: Volume 7a2cbe83-ceac-42d2-b900-28cfc410a41e could not be found. {{(pid=127033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:59:48.925853 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-e4068030-0571-4f33-9309-4843bf41d2b4 tempest-VolumesSnapshotsTestJSON-933147594 tempest-VolumesSnapshotsTestJSON-933147594-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/7a2cbe83-ceac-42d2-b900-28cfc410a41e" status: 404 len: 109 microversion: 2.1 time: 0.035641 Oct 28 09:59:48.925853 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 497/1013] 10.222.0.52 () {58 vars in 1245 bytes} [Fri Oct 28 09:59:48 2022] GET /compute/v2.1/os-volumes/7a2cbe83-ceac-42d2-b900-28cfc410a41e => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:02:02.775586 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG dbcounter [-] [127032] Writing DB stats nova_api:SELECT=43,nova_api:DELETE=1 {{(pid=127032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:02:02.776376 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG dbcounter [-] [127032] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:02:02.777802 dv-cinder-zed-3-smb devstack@n-api.service[127032]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5d7c5224-ce39-4829-8295-428f758aadb9] AMQP server on 10.222.0.52:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 28 10:02:02.779456 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 28 10:02:02.779591 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Fri Oct 28 10:02:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d9b6a132-b028-452c-8b88-fc7b27ef8c0f/action (ip 10.222.0.52) !!! Oct 28 10:02:02.786856 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-841ac851-77ca-411e-9596-7e5e11671d18 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:02:02.787384 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-841ac851-77ca-411e-9596-7e5e11671d18 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] [instance: d9b6a132-b028-452c-8b88-fc7b27ef8c0f] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:02.796585 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-841ac851-77ca-411e-9596-7e5e11671d18 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:02.797718 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-841ac851-77ca-411e-9596-7e5e11671d18 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:02.798153 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-841ac851-77ca-411e-9596-7e5e11671d18 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:02.798841 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-841ac851-77ca-411e-9596-7e5e11671d18 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:02.799292 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-841ac851-77ca-411e-9596-7e5e11671d18 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:02.799711 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-841ac851-77ca-411e-9596-7e5e11671d18 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:02.822088 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.objects.instance [None req-841ac851-77ca-411e-9596-7e5e11671d18 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Lazy-loading 'flavor' on Instance uuid d9b6a132-b028-452c-8b88-fc7b27ef8c0f {{(pid=127032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 10:02:02.890983 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-841ac851-77ca-411e-9596-7e5e11671d18 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] 10.222.0.52 "POST /compute/v2.1/servers/d9b6a132-b028-452c-8b88-fc7b27ef8c0f/action" status: 202 len: 0 microversion: 2.1 time: 0.116140 Oct 28 10:02:02.891563 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 517/1014] 10.222.0.52 () {60 vars in 1278 bytes} [Fri Oct 28 10:02:02 2022] POST /compute/v2.1/servers/d9b6a132-b028-452c-8b88-fc7b27ef8c0f/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 10:02:02.897052 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG dbcounter [-] [127033] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:02:02.897819 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG dbcounter [-] [127033] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:02:02.899451 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f5953724-98a4-43e3-ae3a-11410f697a96] AMQP server on 10.222.0.52:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 28 10:02:02.900526 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 10:02:02.900732 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Fri Oct 28 10:02:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d9b6a132-b028-452c-8b88-fc7b27ef8c0f (ip 10.222.0.52) !!! Oct 28 10:02:02.902203 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 28 10:02:02.902331 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Fri Oct 28 10:02:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d9b6a132-b028-452c-8b88-fc7b27ef8c0f (ip 10.222.0.52) !!! Oct 28 10:02:02.909237 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-b52d59b4-50c9-4d8c-9133-0ea60f932d6d tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:02.909843 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-b52d59b4-50c9-4d8c-9133-0ea60f932d6d tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] [instance: d9b6a132-b028-452c-8b88-fc7b27ef8c0f] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:02.920216 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-b52d59b4-50c9-4d8c-9133-0ea60f932d6d tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:02.920632 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-b52d59b4-50c9-4d8c-9133-0ea60f932d6d tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:02.921066 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-b52d59b4-50c9-4d8c-9133-0ea60f932d6d tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:02.922437 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-b52d59b4-50c9-4d8c-9133-0ea60f932d6d tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:02.922918 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-b52d59b4-50c9-4d8c-9133-0ea60f932d6d tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:02.923323 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-b52d59b4-50c9-4d8c-9133-0ea60f932d6d tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:03.172368 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-b52d59b4-50c9-4d8c-9133-0ea60f932d6d tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9bb73c501c444ca98c8af9d7b4c7bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce53f0f4dec4042a2cd5a3213b82f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:03.180031 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-b52d59b4-50c9-4d8c-9133-0ea60f932d6d tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] 10.222.0.52 "GET /compute/v2.1/servers/d9b6a132-b028-452c-8b88-fc7b27ef8c0f" status: 200 len: 1568 microversion: 2.1 time: 0.284163 Oct 28 10:02:03.180596 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 498/1015] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 10:02:02 2022] GET /compute/v2.1/servers/d9b6a132-b028-452c-8b88-fc7b27ef8c0f => generated 1568 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:02:04.205785 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-0463eb7d-d814-4d14-9d1d-7a1b238e9ba7 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:04.206496 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-0463eb7d-d814-4d14-9d1d-7a1b238e9ba7 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] [instance: d9b6a132-b028-452c-8b88-fc7b27ef8c0f] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:04.215108 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-0463eb7d-d814-4d14-9d1d-7a1b238e9ba7 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:04.215592 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-0463eb7d-d814-4d14-9d1d-7a1b238e9ba7 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:04.216059 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-0463eb7d-d814-4d14-9d1d-7a1b238e9ba7 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:04.216753 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-0463eb7d-d814-4d14-9d1d-7a1b238e9ba7 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:04.217210 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-0463eb7d-d814-4d14-9d1d-7a1b238e9ba7 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:04.217635 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-0463eb7d-d814-4d14-9d1d-7a1b238e9ba7 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:04.221319 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO oslo.messaging._drivers.impl_rabbit [-] [5d7c5224-ce39-4829-8295-428f758aadb9] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 46068. Oct 28 10:02:04.401215 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-0463eb7d-d814-4d14-9d1d-7a1b238e9ba7 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9bb73c501c444ca98c8af9d7b4c7bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce53f0f4dec4042a2cd5a3213b82f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:04.408887 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-0463eb7d-d814-4d14-9d1d-7a1b238e9ba7 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] 10.222.0.52 "GET /compute/v2.1/servers/d9b6a132-b028-452c-8b88-fc7b27ef8c0f" status: 200 len: 1568 microversion: 2.1 time: 0.210135 Oct 28 10:02:04.409441 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 518/1016] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 10:02:04 2022] GET /compute/v2.1/servers/d9b6a132-b028-452c-8b88-fc7b27ef8c0f => generated 1568 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:02:05.431805 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-7e5a2c1a-8ae2-4025-a231-ad4e69d7714a tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:05.432421 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-7e5a2c1a-8ae2-4025-a231-ad4e69d7714a tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] [instance: d9b6a132-b028-452c-8b88-fc7b27ef8c0f] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:05.440334 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-7e5a2c1a-8ae2-4025-a231-ad4e69d7714a tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:05.440820 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-7e5a2c1a-8ae2-4025-a231-ad4e69d7714a tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:05.441254 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-7e5a2c1a-8ae2-4025-a231-ad4e69d7714a tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:05.441946 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-7e5a2c1a-8ae2-4025-a231-ad4e69d7714a tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:05.442403 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-7e5a2c1a-8ae2-4025-a231-ad4e69d7714a tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:05.442829 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-7e5a2c1a-8ae2-4025-a231-ad4e69d7714a tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:05.458713 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO oslo.messaging._drivers.impl_rabbit [-] [f5953724-98a4-43e3-ae3a-11410f697a96] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 46074. Oct 28 10:02:05.574210 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-7e5a2c1a-8ae2-4025-a231-ad4e69d7714a tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9bb73c501c444ca98c8af9d7b4c7bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce53f0f4dec4042a2cd5a3213b82f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:05.582433 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-7e5a2c1a-8ae2-4025-a231-ad4e69d7714a tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] 10.222.0.52 "GET /compute/v2.1/servers/d9b6a132-b028-452c-8b88-fc7b27ef8c0f" status: 200 len: 1568 microversion: 2.1 time: 0.154638 Oct 28 10:02:05.582995 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 499/1017] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 10:02:05 2022] GET /compute/v2.1/servers/d9b6a132-b028-452c-8b88-fc7b27ef8c0f => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:02:06.605800 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-3bdc4477-5741-453f-9f6d-cceacb45f16d tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:06.606421 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-3bdc4477-5741-453f-9f6d-cceacb45f16d tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] [instance: d9b6a132-b028-452c-8b88-fc7b27ef8c0f] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:06.612777 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-3bdc4477-5741-453f-9f6d-cceacb45f16d tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:06.613259 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-3bdc4477-5741-453f-9f6d-cceacb45f16d tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:06.613690 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-3bdc4477-5741-453f-9f6d-cceacb45f16d tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:06.614373 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-3bdc4477-5741-453f-9f6d-cceacb45f16d tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:06.614826 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-3bdc4477-5741-453f-9f6d-cceacb45f16d tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:06.615248 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-3bdc4477-5741-453f-9f6d-cceacb45f16d tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:06.741361 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-3bdc4477-5741-453f-9f6d-cceacb45f16d tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9bb73c501c444ca98c8af9d7b4c7bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce53f0f4dec4042a2cd5a3213b82f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:06.749048 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-3bdc4477-5741-453f-9f6d-cceacb45f16d tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] 10.222.0.52 "GET /compute/v2.1/servers/d9b6a132-b028-452c-8b88-fc7b27ef8c0f" status: 200 len: 1568 microversion: 2.1 time: 0.147395 Oct 28 10:02:06.749726 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 519/1018] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 10:02:06 2022] GET /compute/v2.1/servers/d9b6a132-b028-452c-8b88-fc7b27ef8c0f => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:02:07.773632 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-e69d4a5c-d5f8-4a1d-8249-75338bcfec9f tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:07.774235 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-e69d4a5c-d5f8-4a1d-8249-75338bcfec9f tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] [instance: d9b6a132-b028-452c-8b88-fc7b27ef8c0f] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:07.780627 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-e69d4a5c-d5f8-4a1d-8249-75338bcfec9f tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:07.781113 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-e69d4a5c-d5f8-4a1d-8249-75338bcfec9f tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:07.781548 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-e69d4a5c-d5f8-4a1d-8249-75338bcfec9f tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:07.782858 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-e69d4a5c-d5f8-4a1d-8249-75338bcfec9f tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:07.783315 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-e69d4a5c-d5f8-4a1d-8249-75338bcfec9f tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:07.783738 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-e69d4a5c-d5f8-4a1d-8249-75338bcfec9f tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:07.912755 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-e69d4a5c-d5f8-4a1d-8249-75338bcfec9f tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9bb73c501c444ca98c8af9d7b4c7bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce53f0f4dec4042a2cd5a3213b82f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:07.921300 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-e69d4a5c-d5f8-4a1d-8249-75338bcfec9f tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] 10.222.0.52 "GET /compute/v2.1/servers/d9b6a132-b028-452c-8b88-fc7b27ef8c0f" status: 200 len: 1568 microversion: 2.1 time: 0.151631 Oct 28 10:02:07.921875 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 500/1019] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 10:02:07 2022] GET /compute/v2.1/servers/d9b6a132-b028-452c-8b88-fc7b27ef8c0f => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:02:08.944708 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-383437b7-0e92-47a4-b120-49c1a0792345 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:08.945303 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-383437b7-0e92-47a4-b120-49c1a0792345 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] [instance: d9b6a132-b028-452c-8b88-fc7b27ef8c0f] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:08.951700 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-383437b7-0e92-47a4-b120-49c1a0792345 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:08.952226 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-383437b7-0e92-47a4-b120-49c1a0792345 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:08.952664 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-383437b7-0e92-47a4-b120-49c1a0792345 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:08.953350 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-383437b7-0e92-47a4-b120-49c1a0792345 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:08.953807 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-383437b7-0e92-47a4-b120-49c1a0792345 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:08.954231 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-383437b7-0e92-47a4-b120-49c1a0792345 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:09.085965 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-383437b7-0e92-47a4-b120-49c1a0792345 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9bb73c501c444ca98c8af9d7b4c7bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce53f0f4dec4042a2cd5a3213b82f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:09.093568 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-383437b7-0e92-47a4-b120-49c1a0792345 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] 10.222.0.52 "GET /compute/v2.1/servers/d9b6a132-b028-452c-8b88-fc7b27ef8c0f" status: 200 len: 1568 microversion: 2.1 time: 0.152830 Oct 28 10:02:09.094129 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 520/1020] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 10:02:08 2022] GET /compute/v2.1/servers/d9b6a132-b028-452c-8b88-fc7b27ef8c0f => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:02:10.117077 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-6d510e3b-8a81-4a04-9a77-b5dbf0b02754 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:10.117689 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-6d510e3b-8a81-4a04-9a77-b5dbf0b02754 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] [instance: d9b6a132-b028-452c-8b88-fc7b27ef8c0f] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:10.124077 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-6d510e3b-8a81-4a04-9a77-b5dbf0b02754 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:10.124565 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-6d510e3b-8a81-4a04-9a77-b5dbf0b02754 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:10.124999 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-6d510e3b-8a81-4a04-9a77-b5dbf0b02754 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:10.125761 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-6d510e3b-8a81-4a04-9a77-b5dbf0b02754 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:10.126176 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-6d510e3b-8a81-4a04-9a77-b5dbf0b02754 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:10.126601 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-6d510e3b-8a81-4a04-9a77-b5dbf0b02754 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:10.255117 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-6d510e3b-8a81-4a04-9a77-b5dbf0b02754 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9bb73c501c444ca98c8af9d7b4c7bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce53f0f4dec4042a2cd5a3213b82f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:10.263150 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-6d510e3b-8a81-4a04-9a77-b5dbf0b02754 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] 10.222.0.52 "GET /compute/v2.1/servers/d9b6a132-b028-452c-8b88-fc7b27ef8c0f" status: 200 len: 1568 microversion: 2.1 time: 0.149997 Oct 28 10:02:10.263720 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 501/1021] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 10:02:10 2022] GET /compute/v2.1/servers/d9b6a132-b028-452c-8b88-fc7b27ef8c0f => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:02:11.286486 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-d0b34650-e0f7-48b8-a974-da92748b3d17 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:11.287089 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-d0b34650-e0f7-48b8-a974-da92748b3d17 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] [instance: d9b6a132-b028-452c-8b88-fc7b27ef8c0f] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:11.293430 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-d0b34650-e0f7-48b8-a974-da92748b3d17 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:11.293905 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-d0b34650-e0f7-48b8-a974-da92748b3d17 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:11.294330 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-d0b34650-e0f7-48b8-a974-da92748b3d17 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:11.295005 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-d0b34650-e0f7-48b8-a974-da92748b3d17 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:11.295455 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-d0b34650-e0f7-48b8-a974-da92748b3d17 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:11.295902 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-d0b34650-e0f7-48b8-a974-da92748b3d17 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:11.425981 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-d0b34650-e0f7-48b8-a974-da92748b3d17 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9bb73c501c444ca98c8af9d7b4c7bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce53f0f4dec4042a2cd5a3213b82f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:11.433541 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-d0b34650-e0f7-48b8-a974-da92748b3d17 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] 10.222.0.52 "GET /compute/v2.1/servers/d9b6a132-b028-452c-8b88-fc7b27ef8c0f" status: 200 len: 1568 microversion: 2.1 time: 0.150971 Oct 28 10:02:11.434105 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 521/1022] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 10:02:11 2022] GET /compute/v2.1/servers/d9b6a132-b028-452c-8b88-fc7b27ef8c0f => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:02:12.456580 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-e9fe3920-c345-4491-a1ba-755b77415179 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:12.457223 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-e9fe3920-c345-4491-a1ba-755b77415179 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] [instance: d9b6a132-b028-452c-8b88-fc7b27ef8c0f] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:12.463646 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-e9fe3920-c345-4491-a1ba-755b77415179 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:12.464163 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-e9fe3920-c345-4491-a1ba-755b77415179 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:12.464629 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-e9fe3920-c345-4491-a1ba-755b77415179 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:12.465315 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-e9fe3920-c345-4491-a1ba-755b77415179 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:12.465771 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-e9fe3920-c345-4491-a1ba-755b77415179 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:12.466196 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-e9fe3920-c345-4491-a1ba-755b77415179 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:12.592023 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-e9fe3920-c345-4491-a1ba-755b77415179 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9bb73c501c444ca98c8af9d7b4c7bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce53f0f4dec4042a2cd5a3213b82f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:12.600210 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-e9fe3920-c345-4491-a1ba-755b77415179 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] 10.222.0.52 "GET /compute/v2.1/servers/d9b6a132-b028-452c-8b88-fc7b27ef8c0f" status: 200 len: 1568 microversion: 2.1 time: 0.147472 Oct 28 10:02:12.600766 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 502/1023] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 10:02:12 2022] GET /compute/v2.1/servers/d9b6a132-b028-452c-8b88-fc7b27ef8c0f => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:02:13.623929 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-594e1488-890b-4903-a84c-22dc746df2f6 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:13.624494 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-594e1488-890b-4903-a84c-22dc746df2f6 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] [instance: d9b6a132-b028-452c-8b88-fc7b27ef8c0f] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:13.631771 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-594e1488-890b-4903-a84c-22dc746df2f6 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:13.632280 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-594e1488-890b-4903-a84c-22dc746df2f6 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:13.632711 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-594e1488-890b-4903-a84c-22dc746df2f6 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:13.633401 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-594e1488-890b-4903-a84c-22dc746df2f6 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:13.633859 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-594e1488-890b-4903-a84c-22dc746df2f6 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:13.634282 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-594e1488-890b-4903-a84c-22dc746df2f6 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:13.762784 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-594e1488-890b-4903-a84c-22dc746df2f6 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9bb73c501c444ca98c8af9d7b4c7bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce53f0f4dec4042a2cd5a3213b82f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:13.770636 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-594e1488-890b-4903-a84c-22dc746df2f6 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] 10.222.0.52 "GET /compute/v2.1/servers/d9b6a132-b028-452c-8b88-fc7b27ef8c0f" status: 200 len: 1568 microversion: 2.1 time: 0.150803 Oct 28 10:02:13.771197 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 522/1024] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 10:02:13 2022] GET /compute/v2.1/servers/d9b6a132-b028-452c-8b88-fc7b27ef8c0f => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:02:14.793398 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-a34be26f-5ae5-4556-ab3c-54274691c7fc tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:14.794008 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-a34be26f-5ae5-4556-ab3c-54274691c7fc tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] [instance: d9b6a132-b028-452c-8b88-fc7b27ef8c0f] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:14.801132 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-a34be26f-5ae5-4556-ab3c-54274691c7fc tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:14.801614 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-a34be26f-5ae5-4556-ab3c-54274691c7fc tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:14.802047 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-a34be26f-5ae5-4556-ab3c-54274691c7fc tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:14.802730 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-a34be26f-5ae5-4556-ab3c-54274691c7fc tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:14.803185 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-a34be26f-5ae5-4556-ab3c-54274691c7fc tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:14.803607 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-a34be26f-5ae5-4556-ab3c-54274691c7fc tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:14.936309 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-a34be26f-5ae5-4556-ab3c-54274691c7fc tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9bb73c501c444ca98c8af9d7b4c7bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce53f0f4dec4042a2cd5a3213b82f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:14.944046 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-a34be26f-5ae5-4556-ab3c-54274691c7fc tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] 10.222.0.52 "GET /compute/v2.1/servers/d9b6a132-b028-452c-8b88-fc7b27ef8c0f" status: 200 len: 1568 microversion: 2.1 time: 0.154594 Oct 28 10:02:14.944603 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 503/1025] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 10:02:14 2022] GET /compute/v2.1/servers/d9b6a132-b028-452c-8b88-fc7b27ef8c0f => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:02:15.966543 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-0eb2fab2-9f72-44f2-9148-3d5aae7ce2d3 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:15.967125 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-0eb2fab2-9f72-44f2-9148-3d5aae7ce2d3 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] [instance: d9b6a132-b028-452c-8b88-fc7b27ef8c0f] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:15.973466 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-0eb2fab2-9f72-44f2-9148-3d5aae7ce2d3 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:15.973944 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-0eb2fab2-9f72-44f2-9148-3d5aae7ce2d3 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:15.974369 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-0eb2fab2-9f72-44f2-9148-3d5aae7ce2d3 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:15.975045 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-0eb2fab2-9f72-44f2-9148-3d5aae7ce2d3 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:15.975489 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-0eb2fab2-9f72-44f2-9148-3d5aae7ce2d3 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:15.975936 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-0eb2fab2-9f72-44f2-9148-3d5aae7ce2d3 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:16.103237 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-0eb2fab2-9f72-44f2-9148-3d5aae7ce2d3 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9bb73c501c444ca98c8af9d7b4c7bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce53f0f4dec4042a2cd5a3213b82f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:16.111485 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-0eb2fab2-9f72-44f2-9148-3d5aae7ce2d3 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] 10.222.0.52 "GET /compute/v2.1/servers/d9b6a132-b028-452c-8b88-fc7b27ef8c0f" status: 200 len: 1509 microversion: 2.1 time: 0.148877 Oct 28 10:02:16.112631 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 523/1026] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 10:02:15 2022] GET /compute/v2.1/servers/d9b6a132-b028-452c-8b88-fc7b27ef8c0f => generated 1509 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:02:16.135190 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-7ff24269-46f3-4db7-9ba2-13086bd6d8d6 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:02:16.135814 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-7ff24269-46f3-4db7-9ba2-13086bd6d8d6 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] [instance: d9b6a132-b028-452c-8b88-fc7b27ef8c0f] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:16.142202 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-7ff24269-46f3-4db7-9ba2-13086bd6d8d6 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:16.142690 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-7ff24269-46f3-4db7-9ba2-13086bd6d8d6 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:16.143122 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-7ff24269-46f3-4db7-9ba2-13086bd6d8d6 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:16.143841 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-7ff24269-46f3-4db7-9ba2-13086bd6d8d6 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:16.144299 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-7ff24269-46f3-4db7-9ba2-13086bd6d8d6 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:16.144719 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-7ff24269-46f3-4db7-9ba2-13086bd6d8d6 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:16.184416 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-7ff24269-46f3-4db7-9ba2-13086bd6d8d6 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] [instance: d9b6a132-b028-452c-8b88-fc7b27ef8c0f] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127033) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 28 10:02:16.247659 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-7ff24269-46f3-4db7-9ba2-13086bd6d8d6 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] 10.222.0.52 "POST /compute/v2.1/servers/d9b6a132-b028-452c-8b88-fc7b27ef8c0f/action" status: 202 len: 0 microversion: 2.1 time: 0.116585 Oct 28 10:02:16.248307 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 504/1027] 10.222.0.52 () {60 vars in 1278 bytes} [Fri Oct 28 10:02:16 2022] POST /compute/v2.1/servers/d9b6a132-b028-452c-8b88-fc7b27ef8c0f/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 10:02:16.257093 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-7416bd59-dc78-4267-b73b-284de1b227bc tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:16.257706 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-7416bd59-dc78-4267-b73b-284de1b227bc tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] [instance: d9b6a132-b028-452c-8b88-fc7b27ef8c0f] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:16.263558 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-7416bd59-dc78-4267-b73b-284de1b227bc tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:16.264093 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-7416bd59-dc78-4267-b73b-284de1b227bc tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:16.264669 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-7416bd59-dc78-4267-b73b-284de1b227bc tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:16.265371 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-7416bd59-dc78-4267-b73b-284de1b227bc tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:16.265830 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-7416bd59-dc78-4267-b73b-284de1b227bc tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:16.266257 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-7416bd59-dc78-4267-b73b-284de1b227bc tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:16.439247 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-7416bd59-dc78-4267-b73b-284de1b227bc tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9bb73c501c444ca98c8af9d7b4c7bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce53f0f4dec4042a2cd5a3213b82f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:16.446916 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-7416bd59-dc78-4267-b73b-284de1b227bc tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] 10.222.0.52 "GET /compute/v2.1/servers/d9b6a132-b028-452c-8b88-fc7b27ef8c0f" status: 200 len: 1517 microversion: 2.1 time: 0.193909 Oct 28 10:02:16.447610 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 524/1028] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 10:02:16 2022] GET /compute/v2.1/servers/d9b6a132-b028-452c-8b88-fc7b27ef8c0f => generated 1517 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:02:17.471295 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-1ef177f9-f465-4776-a46e-3320e613069c tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:17.471967 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-1ef177f9-f465-4776-a46e-3320e613069c tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] [instance: d9b6a132-b028-452c-8b88-fc7b27ef8c0f] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:17.477821 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-1ef177f9-f465-4776-a46e-3320e613069c tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:17.478376 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-1ef177f9-f465-4776-a46e-3320e613069c tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:17.478847 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-1ef177f9-f465-4776-a46e-3320e613069c tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:17.479536 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-1ef177f9-f465-4776-a46e-3320e613069c tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:17.480019 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-1ef177f9-f465-4776-a46e-3320e613069c tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:17.480442 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-1ef177f9-f465-4776-a46e-3320e613069c tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:17.804382 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-1ef177f9-f465-4776-a46e-3320e613069c tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9bb73c501c444ca98c8af9d7b4c7bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce53f0f4dec4042a2cd5a3213b82f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:17.812327 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-1ef177f9-f465-4776-a46e-3320e613069c tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] 10.222.0.52 "GET /compute/v2.1/servers/d9b6a132-b028-452c-8b88-fc7b27ef8c0f" status: 200 len: 1519 microversion: 2.1 time: 0.345681 Oct 28 10:02:17.812910 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 505/1029] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 10:02:17 2022] GET /compute/v2.1/servers/d9b6a132-b028-452c-8b88-fc7b27ef8c0f => generated 1519 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:02:18.812260 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [req-190f80c9-991d-4ade-88a6-a0d16364e8cd req-41d297a8-d4c4-47b3-893c-acbd5bfa8bea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9b6a132-b028-452c-8b88-fc7b27ef8c0f", "name": "network-vif-unplugged", "status": "completed", "tag": "68c29671-d76d-40cf-af9c-23b8f386cff8"}]} {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:02:18.821794 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-190f80c9-991d-4ade-88a6-a0d16364e8cd req-41d297a8-d4c4-47b3-893c-acbd5bfa8bea service nova] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:18.822284 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-190f80c9-991d-4ade-88a6-a0d16364e8cd req-41d297a8-d4c4-47b3-893c-acbd5bfa8bea service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:18.822714 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [req-190f80c9-991d-4ade-88a6-a0d16364e8cd req-41d297a8-d4c4-47b3-893c-acbd5bfa8bea service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:18.834692 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.compute.server_external_events [req-190f80c9-991d-4ade-88a6-a0d16364e8cd req-41d297a8-d4c4-47b3-893c-acbd5bfa8bea service nova] Creating event network-vif-unplugged:68c29671-d76d-40cf-af9c-23b8f386cff8 for instance d9b6a132-b028-452c-8b88-fc7b27ef8c0f on hv-cinder-zed-3 Oct 28 10:02:18.836179 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-0beae71f-265f-450b-82e9-5e4f3bfa0b6a tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:18.836791 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-0beae71f-265f-450b-82e9-5e4f3bfa0b6a tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] [instance: d9b6a132-b028-452c-8b88-fc7b27ef8c0f] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:18.840119 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [req-190f80c9-991d-4ade-88a6-a0d16364e8cd req-41d297a8-d4c4-47b3-893c-acbd5bfa8bea service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.091566 Oct 28 10:02:18.840721 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 525/1030] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Oct 28 10:02:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:02:18.843042 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-0beae71f-265f-450b-82e9-5e4f3bfa0b6a tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:18.843433 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-0beae71f-265f-450b-82e9-5e4f3bfa0b6a tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:18.843862 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-0beae71f-265f-450b-82e9-5e4f3bfa0b6a tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:18.844555 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-0beae71f-265f-450b-82e9-5e4f3bfa0b6a tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:18.845702 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-0beae71f-265f-450b-82e9-5e4f3bfa0b6a tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:18.846126 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-0beae71f-265f-450b-82e9-5e4f3bfa0b6a tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:18.976159 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-0beae71f-265f-450b-82e9-5e4f3bfa0b6a tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9bb73c501c444ca98c8af9d7b4c7bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce53f0f4dec4042a2cd5a3213b82f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:18.983870 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-0beae71f-265f-450b-82e9-5e4f3bfa0b6a tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] 10.222.0.52 "GET /compute/v2.1/servers/d9b6a132-b028-452c-8b88-fc7b27ef8c0f" status: 200 len: 1575 microversion: 2.1 time: 0.151675 Oct 28 10:02:18.984426 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 506/1031] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 10:02:18 2022] GET /compute/v2.1/servers/d9b6a132-b028-452c-8b88-fc7b27ef8c0f => generated 1575 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:02:20.006854 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-68a4a8da-77cc-4ee3-bc94-6cf904764b48 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:20.007538 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-68a4a8da-77cc-4ee3-bc94-6cf904764b48 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] [instance: d9b6a132-b028-452c-8b88-fc7b27ef8c0f] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:20.014297 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-68a4a8da-77cc-4ee3-bc94-6cf904764b48 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:20.014781 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-68a4a8da-77cc-4ee3-bc94-6cf904764b48 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:20.015214 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-68a4a8da-77cc-4ee3-bc94-6cf904764b48 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:20.015937 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-68a4a8da-77cc-4ee3-bc94-6cf904764b48 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:20.016391 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-68a4a8da-77cc-4ee3-bc94-6cf904764b48 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:20.016812 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-68a4a8da-77cc-4ee3-bc94-6cf904764b48 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:20.147807 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-68a4a8da-77cc-4ee3-bc94-6cf904764b48 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9bb73c501c444ca98c8af9d7b4c7bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce53f0f4dec4042a2cd5a3213b82f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:20.155468 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-68a4a8da-77cc-4ee3-bc94-6cf904764b48 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] 10.222.0.52 "GET /compute/v2.1/servers/d9b6a132-b028-452c-8b88-fc7b27ef8c0f" status: 200 len: 1575 microversion: 2.1 time: 0.153130 Oct 28 10:02:20.156055 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 526/1032] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 10:02:20 2022] GET /compute/v2.1/servers/d9b6a132-b028-452c-8b88-fc7b27ef8c0f => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:02:21.178730 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-37dcb53e-a682-4622-b105-1a7464188d62 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:21.179342 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-37dcb53e-a682-4622-b105-1a7464188d62 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] [instance: d9b6a132-b028-452c-8b88-fc7b27ef8c0f] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:21.185749 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-37dcb53e-a682-4622-b105-1a7464188d62 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:21.186230 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-37dcb53e-a682-4622-b105-1a7464188d62 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:21.186670 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-37dcb53e-a682-4622-b105-1a7464188d62 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:21.187354 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-37dcb53e-a682-4622-b105-1a7464188d62 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:21.187841 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-37dcb53e-a682-4622-b105-1a7464188d62 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:21.188267 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-37dcb53e-a682-4622-b105-1a7464188d62 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:21.314234 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-37dcb53e-a682-4622-b105-1a7464188d62 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9bb73c501c444ca98c8af9d7b4c7bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce53f0f4dec4042a2cd5a3213b82f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:21.321916 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-37dcb53e-a682-4622-b105-1a7464188d62 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] 10.222.0.52 "GET /compute/v2.1/servers/d9b6a132-b028-452c-8b88-fc7b27ef8c0f" status: 200 len: 1575 microversion: 2.1 time: 0.147159 Oct 28 10:02:21.322478 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 507/1033] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 10:02:21 2022] GET /compute/v2.1/servers/d9b6a132-b028-452c-8b88-fc7b27ef8c0f => generated 1575 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:02:22.345397 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-3d4109a7-e918-455b-9570-f17ef9e9fd4d tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:22.346009 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-3d4109a7-e918-455b-9570-f17ef9e9fd4d tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] [instance: d9b6a132-b028-452c-8b88-fc7b27ef8c0f] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:22.352415 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-3d4109a7-e918-455b-9570-f17ef9e9fd4d tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:22.352904 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-3d4109a7-e918-455b-9570-f17ef9e9fd4d tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:22.353344 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-3d4109a7-e918-455b-9570-f17ef9e9fd4d tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:22.354029 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-3d4109a7-e918-455b-9570-f17ef9e9fd4d tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:22.354486 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-3d4109a7-e918-455b-9570-f17ef9e9fd4d tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:22.354912 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-3d4109a7-e918-455b-9570-f17ef9e9fd4d tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:22.488993 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-3d4109a7-e918-455b-9570-f17ef9e9fd4d tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9bb73c501c444ca98c8af9d7b4c7bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce53f0f4dec4042a2cd5a3213b82f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:22.496688 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-3d4109a7-e918-455b-9570-f17ef9e9fd4d tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] 10.222.0.52 "GET /compute/v2.1/servers/d9b6a132-b028-452c-8b88-fc7b27ef8c0f" status: 200 len: 1562 microversion: 2.1 time: 0.155222 Oct 28 10:02:22.497254 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 527/1034] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 10:02:22 2022] GET /compute/v2.1/servers/d9b6a132-b028-452c-8b88-fc7b27ef8c0f => generated 1562 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:02:24.835329 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [req-764edf7c-555e-4ae1-b1a1-6a13a272966e req-2b6679ef-0fb4-414e-8fed-bc09ee08e692 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9b6a132-b028-452c-8b88-fc7b27ef8c0f", "name": "network-vif-plugged", "status": "completed", "tag": "68c29671-d76d-40cf-af9c-23b8f386cff8"}]} {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:02:24.846560 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-764edf7c-555e-4ae1-b1a1-6a13a272966e req-2b6679ef-0fb4-414e-8fed-bc09ee08e692 service nova] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:24.847043 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-764edf7c-555e-4ae1-b1a1-6a13a272966e req-2b6679ef-0fb4-414e-8fed-bc09ee08e692 service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:24.847466 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-764edf7c-555e-4ae1-b1a1-6a13a272966e req-2b6679ef-0fb4-414e-8fed-bc09ee08e692 service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:24.858694 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.compute.server_external_events [req-764edf7c-555e-4ae1-b1a1-6a13a272966e req-2b6679ef-0fb4-414e-8fed-bc09ee08e692 service nova] Creating event network-vif-plugged:68c29671-d76d-40cf-af9c-23b8f386cff8 for instance d9b6a132-b028-452c-8b88-fc7b27ef8c0f on hv-cinder-zed-3 Oct 28 10:02:24.862148 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR oslo.messaging._drivers.impl_rabbit [req-764edf7c-555e-4ae1-b1a1-6a13a272966e req-2b6679ef-0fb4-414e-8fed-bc09ee08e692 service nova] [34552098-0dc0-4e0a-b093-796ed4b1e5cd] AMQP server on 10.222.0.52:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 28 10:02:25.868848 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO oslo.messaging._drivers.impl_rabbit [req-764edf7c-555e-4ae1-b1a1-6a13a272966e req-2b6679ef-0fb4-414e-8fed-bc09ee08e692 service nova] [34552098-0dc0-4e0a-b093-796ed4b1e5cd] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 46132. Oct 28 10:02:25.872103 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [req-764edf7c-555e-4ae1-b1a1-6a13a272966e req-2b6679ef-0fb4-414e-8fed-bc09ee08e692 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.041635 Oct 28 10:02:25.872708 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 508/1035] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Oct 28 10:02:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:03:59.347506 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-d936fc35-9c58-4a0c-a443-d1b0780d9c18 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:59.348051 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-d936fc35-9c58-4a0c-a443-d1b0780d9c18 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] [instance: d9b6a132-b028-452c-8b88-fc7b27ef8c0f] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:59.350150 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG dbcounter [-] [127032] Writing DB stats nova_api:SELECT=22 {{(pid=127032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:03:59.350811 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG dbcounter [-] [127032] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:03:59.351615 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 10:03:59.351865 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Fri Oct 28 10:03:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d9b6a132-b028-452c-8b88-fc7b27ef8c0f (ip 10.222.0.52) !!! Oct 28 10:03:59.355106 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG dbcounter [-] [127033] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1 {{(pid=127033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:03:59.356195 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG dbcounter [-] [127033] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:03:59.364921 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 10:03:59.364921 dv-cinder-zed-3-smb devstack@n-api.service[127032]: Fri Oct 28 10:03:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d9b6a132-b028-452c-8b88-fc7b27ef8c0f (ip 10.222.0.52) !!! Oct 28 10:03:59.378065 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-d936fc35-9c58-4a0c-a443-d1b0780d9c18 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:59.378560 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-d936fc35-9c58-4a0c-a443-d1b0780d9c18 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:59.378995 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-d936fc35-9c58-4a0c-a443-d1b0780d9c18 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:59.379699 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-d936fc35-9c58-4a0c-a443-d1b0780d9c18 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:59.380192 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-d936fc35-9c58-4a0c-a443-d1b0780d9c18 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:59.380616 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-d936fc35-9c58-4a0c-a443-d1b0780d9c18 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:59.411633 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-d936fc35-9c58-4a0c-a443-d1b0780d9c18 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] [instance: d9b6a132-b028-452c-8b88-fc7b27ef8c0f] Going to try to terminate instance {{(pid=127032) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 10:03:59.496642 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-d936fc35-9c58-4a0c-a443-d1b0780d9c18 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] 10.222.0.52 "DELETE /compute/v2.1/servers/d9b6a132-b028-452c-8b88-fc7b27ef8c0f" status: 204 len: 0 microversion: 2.1 time: 0.153586 Oct 28 10:03:59.497232 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 528/1036] 10.222.0.52 () {58 vars in 1239 bytes} [Fri Oct 28 10:03:59 2022] DELETE /compute/v2.1/servers/d9b6a132-b028-452c-8b88-fc7b27ef8c0f => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 10:03:59.505284 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [req-7f41589b-e3a1-40f8-8808-c68883273ea5 req-005d7d4b-95aa-4a82-aabe-1867b935c2a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9b6a132-b028-452c-8b88-fc7b27ef8c0f", "tag": "68c29671-d76d-40cf-af9c-23b8f386cff8"}]} {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:03:59.507056 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-83760058-48fb-45f9-b013-67b5d47de04b tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:59.507925 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-83760058-48fb-45f9-b013-67b5d47de04b tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] [instance: d9b6a132-b028-452c-8b88-fc7b27ef8c0f] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:59.514488 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-83760058-48fb-45f9-b013-67b5d47de04b tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:59.515024 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-83760058-48fb-45f9-b013-67b5d47de04b tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:59.515413 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-83760058-48fb-45f9-b013-67b5d47de04b tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:59.516534 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-83760058-48fb-45f9-b013-67b5d47de04b tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:59.516988 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-83760058-48fb-45f9-b013-67b5d47de04b tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:59.517387 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-7f41589b-e3a1-40f8-8808-c68883273ea5 req-005d7d4b-95aa-4a82-aabe-1867b935c2a1 service nova] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:59.517515 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-83760058-48fb-45f9-b013-67b5d47de04b tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:59.517960 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-7f41589b-e3a1-40f8-8808-c68883273ea5 req-005d7d4b-95aa-4a82-aabe-1867b935c2a1 service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:59.518458 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-7f41589b-e3a1-40f8-8808-c68883273ea5 req-005d7d4b-95aa-4a82-aabe-1867b935c2a1 service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:59.531453 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.compute.server_external_events [req-7f41589b-e3a1-40f8-8808-c68883273ea5 req-005d7d4b-95aa-4a82-aabe-1867b935c2a1 service nova] Creating event network-changed:68c29671-d76d-40cf-af9c-23b8f386cff8 for instance d9b6a132-b028-452c-8b88-fc7b27ef8c0f on hv-cinder-zed-3 Oct 28 10:03:59.537421 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [req-7f41589b-e3a1-40f8-8808-c68883273ea5 req-005d7d4b-95aa-4a82-aabe-1867b935c2a1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.184224 Oct 28 10:03:59.538639 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 509/1037] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Oct 28 10:03:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:03:59.649957 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-83760058-48fb-45f9-b013-67b5d47de04b tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9bb73c501c444ca98c8af9d7b4c7bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce53f0f4dec4042a2cd5a3213b82f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:59.657765 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-83760058-48fb-45f9-b013-67b5d47de04b tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] 10.222.0.52 "GET /compute/v2.1/servers/d9b6a132-b028-452c-8b88-fc7b27ef8c0f" status: 200 len: 1568 microversion: 2.1 time: 0.155433 Oct 28 10:03:59.658283 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 529/1038] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 10:03:59 2022] GET /compute/v2.1/servers/d9b6a132-b028-452c-8b88-fc7b27ef8c0f => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:04:00.683142 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-201be255-cd15-43c2-bfa4-e7af33273d60 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:04:00.683871 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-201be255-cd15-43c2-bfa4-e7af33273d60 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] [instance: d9b6a132-b028-452c-8b88-fc7b27ef8c0f] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:04:00.689921 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-201be255-cd15-43c2-bfa4-e7af33273d60 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:00.690405 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-201be255-cd15-43c2-bfa4-e7af33273d60 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:00.690839 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-201be255-cd15-43c2-bfa4-e7af33273d60 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:00.691525 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-201be255-cd15-43c2-bfa4-e7af33273d60 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:00.692003 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-201be255-cd15-43c2-bfa4-e7af33273d60 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:00.692427 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-201be255-cd15-43c2-bfa4-e7af33273d60 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:00.822811 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.policy [None req-201be255-cd15-43c2-bfa4-e7af33273d60 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9bb73c501c444ca98c8af9d7b4c7bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce53f0f4dec4042a2cd5a3213b82f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127033) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:04:00.830724 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-201be255-cd15-43c2-bfa4-e7af33273d60 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] 10.222.0.52 "GET /compute/v2.1/servers/d9b6a132-b028-452c-8b88-fc7b27ef8c0f" status: 200 len: 1568 microversion: 2.1 time: 0.152912 Oct 28 10:04:00.831291 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 510/1039] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 10:04:00 2022] GET /compute/v2.1/servers/d9b6a132-b028-452c-8b88-fc7b27ef8c0f => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:04:01.854260 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-ed8679da-8d9c-43e9-92b2-2700297f9eb5 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:04:01.854872 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-ed8679da-8d9c-43e9-92b2-2700297f9eb5 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] [instance: d9b6a132-b028-452c-8b88-fc7b27ef8c0f] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:04:01.861586 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ed8679da-8d9c-43e9-92b2-2700297f9eb5 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:01.862103 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ed8679da-8d9c-43e9-92b2-2700297f9eb5 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:01.862535 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ed8679da-8d9c-43e9-92b2-2700297f9eb5 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:01.863264 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ed8679da-8d9c-43e9-92b2-2700297f9eb5 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:01.863722 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ed8679da-8d9c-43e9-92b2-2700297f9eb5 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:01.864173 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-ed8679da-8d9c-43e9-92b2-2700297f9eb5 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:01.934457 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-ed8679da-8d9c-43e9-92b2-2700297f9eb5 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9bb73c501c444ca98c8af9d7b4c7bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce53f0f4dec4042a2cd5a3213b82f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:04:01.943206 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-ed8679da-8d9c-43e9-92b2-2700297f9eb5 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] 10.222.0.52 "GET /compute/v2.1/servers/d9b6a132-b028-452c-8b88-fc7b27ef8c0f" status: 200 len: 1383 microversion: 2.1 time: 0.092751 Oct 28 10:04:01.944783 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 530/1040] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 10:04:01 2022] GET /compute/v2.1/servers/d9b6a132-b028-452c-8b88-fc7b27ef8c0f => generated 1383 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:04:01.977742 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [req-8735b1ab-6b49-4363-84bb-4c4d8ce95405 req-4d1c122e-b612-4f45-8953-7f9ef5bbaf52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9b6a132-b028-452c-8b88-fc7b27ef8c0f", "name": "network-vif-deleted", "tag": "68c29671-d76d-40cf-af9c-23b8f386cff8"}]} {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:04:01.987790 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-8735b1ab-6b49-4363-84bb-4c4d8ce95405 req-4d1c122e-b612-4f45-8953-7f9ef5bbaf52 service nova] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:01.988277 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-8735b1ab-6b49-4363-84bb-4c4d8ce95405 req-4d1c122e-b612-4f45-8953-7f9ef5bbaf52 service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:01.988710 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [req-8735b1ab-6b49-4363-84bb-4c4d8ce95405 req-4d1c122e-b612-4f45-8953-7f9ef5bbaf52 service nova] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:02.000679 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.compute.server_external_events [req-8735b1ab-6b49-4363-84bb-4c4d8ce95405 req-4d1c122e-b612-4f45-8953-7f9ef5bbaf52 service nova] Creating event network-vif-deleted:68c29671-d76d-40cf-af9c-23b8f386cff8 for instance d9b6a132-b028-452c-8b88-fc7b27ef8c0f on hv-cinder-zed-3 Oct 28 10:04:02.008460 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [req-8735b1ab-6b49-4363-84bb-4c4d8ce95405 req-4d1c122e-b612-4f45-8953-7f9ef5bbaf52 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032491 Oct 28 10:04:02.009062 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 511/1041] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Oct 28 10:04:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:04:02.966561 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-95aee631-f8a3-4f86-bcb5-13f8437d66e3 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Calling method '>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:04:02.967253 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.compute.api [None req-95aee631-f8a3-4f86-bcb5-13f8437d66e3 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] [instance: d9b6a132-b028-452c-8b88-fc7b27ef8c0f] Fetching instance by UUID {{(pid=127032) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:04:02.975286 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-95aee631-f8a3-4f86-bcb5-13f8437d66e3 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:02.976302 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-95aee631-f8a3-4f86-bcb5-13f8437d66e3 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:02.976739 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-95aee631-f8a3-4f86-bcb5-13f8437d66e3 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:02.977428 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-95aee631-f8a3-4f86-bcb5-13f8437d66e3 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:02.977881 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-95aee631-f8a3-4f86-bcb5-13f8437d66e3 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:02.978300 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-95aee631-f8a3-4f86-bcb5-13f8437d66e3 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:03.012057 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-95aee631-f8a3-4f86-bcb5-13f8437d66e3 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:03.012535 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-95aee631-f8a3-4f86-bcb5-13f8437d66e3 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:03.012959 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG oslo_concurrency.lockutils [None req-95aee631-f8a3-4f86-bcb5-13f8437d66e3 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:03.013394 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.objects.instance [None req-95aee631-f8a3-4f86-bcb5-13f8437d66e3 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Lazy-loading 'fault' on Instance uuid d9b6a132-b028-452c-8b88-fc7b27ef8c0f {{(pid=127032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 10:04:03.054041 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.policy [None req-95aee631-f8a3-4f86-bcb5-13f8437d66e3 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b9bb73c501c444ca98c8af9d7b4c7bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce53f0f4dec4042a2cd5a3213b82f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127032) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:04:03.060801 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-95aee631-f8a3-4f86-bcb5-13f8437d66e3 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] 10.222.0.52 "GET /compute/v2.1/servers/d9b6a132-b028-452c-8b88-fc7b27ef8c0f" status: 200 len: 1179 microversion: 2.1 time: 0.098119 Oct 28 10:04:03.061348 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 531/1042] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 10:04:02 2022] GET /compute/v2.1/servers/d9b6a132-b028-452c-8b88-fc7b27ef8c0f => generated 1179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:04:04.085520 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-2a9b6d0f-a28d-4867-b689-88e2ba54b6a7 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Calling method '>' {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:04:04.086214 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.compute.api [None req-2a9b6d0f-a28d-4867-b689-88e2ba54b6a7 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] [instance: d9b6a132-b028-452c-8b88-fc7b27ef8c0f] Fetching instance by UUID {{(pid=127033) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:04:04.094346 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-2a9b6d0f-a28d-4867-b689-88e2ba54b6a7 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:04.094838 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-2a9b6d0f-a28d-4867-b689-88e2ba54b6a7 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:04.095277 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-2a9b6d0f-a28d-4867-b689-88e2ba54b6a7 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:04.096001 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-2a9b6d0f-a28d-4867-b689-88e2ba54b6a7 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Acquiring lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:04.096463 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-2a9b6d0f-a28d-4867-b689-88e2ba54b6a7 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:04.096892 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG oslo_concurrency.lockutils [None req-2a9b6d0f-a28d-4867-b689-88e2ba54b6a7 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Lock "2b15302a-f4a0-4e7f-8af3-7ee6eb916adf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:04.110025 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.wsgi [None req-2a9b6d0f-a28d-4867-b689-88e2ba54b6a7 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] HTTP exception thrown: Instance d9b6a132-b028-452c-8b88-fc7b27ef8c0f could not be found. Oct 28 10:04:04.111641 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-2a9b6d0f-a28d-4867-b689-88e2ba54b6a7 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Request method failure captured: Oct 28 10:04:04.111641 dv-cinder-zed-3-smb devstack@n-api.service[127033]: request: GET /compute/v2.1/servers/d9b6a132-b028-452c-8b88-fc7b27ef8c0f HTTP/1.1 Oct 28 10:04:04.111641 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Accept: application/json Oct 28 10:04:04.111641 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Accept-Encoding: identity Oct 28 10:04:04.111641 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Connection: close Oct 28 10:04:04.111641 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Content-Length: 0 Oct 28 10:04:04.111641 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Content-Type: application/json Oct 28 10:04:04.111641 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Host: 10.222.0.52 Oct 28 10:04:04.111641 dv-cinder-zed-3-smb devstack@n-api.service[127033]: Openstack-System-Scope: None Oct 28 10:04:04.111641 dv-cinder-zed-3-smb devstack@n-api.service[127033]: User-Agent: python-urllib3/1.26.12 Oct 28 10:04:04.111641 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Auth-Token: gAAAAABjW6fkSo9Hy7Ll5kw5YxJkq5fnlPZfja2JKybWdcTQATVhl43BIjTXkGVFX9j-jHyjgPpm2FGUKdgFTVbHQFCP5gv3BeSXt6ncr78iwwePJjwwjACFPF9_wRMzqnIqGOV2SJlIiuBrEtPrdZG9wqytDZ45owMD852hpD-JoE5ShHiIpoE Oct 28 10:04:04.111641 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Domain-Id: None Oct 28 10:04:04.111641 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Domain-Name: None Oct 28 10:04:04.111641 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Identity-Status: Confirmed Oct 28 10:04:04.111641 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Is-Admin-Project: True Oct 28 10:04:04.111641 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Project-Domain-Id: default Oct 28 10:04:04.111641 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Project-Domain-Name: Default Oct 28 10:04:04.111641 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Project-Id: 3ce53f0f4dec4042a2cd5a3213b82f5f Oct 28 10:04:04.111641 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Project-Name: tempest-TestShelveInstance-2022523655 Oct 28 10:04:04.111641 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Role: reader,member Oct 28 10:04:04.111641 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Roles: reader,member Oct 28 10:04:04.113442 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_3ce53f0f4dec4042a2cd5a3213b82f5f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3ce53f0f4dec4042a2cd5a3213b82f5f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3ce53f0f4dec4042a2cd5a3213b82f5f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/3ce53f0f4dec4042a2cd5a3213b82f5f"}]}] Oct 28 10:04:04.113442 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Tenant: tempest-TestShelveInstance-2022523655 Oct 28 10:04:04.113442 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Tenant-Id: 3ce53f0f4dec4042a2cd5a3213b82f5f Oct 28 10:04:04.113442 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-Tenant-Name: tempest-TestShelveInstance-2022523655 Oct 28 10:04:04.113442 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User: tempest-TestShelveInstance-2022523655-project Oct 28 10:04:04.113442 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User-Domain-Id: default Oct 28 10:04:04.113442 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User-Domain-Name: Default Oct 28 10:04:04.113442 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User-Id: 5b9bb73c501c444ca98c8af9d7b4c7bd Oct 28 10:04:04.113442 dv-cinder-zed-3-smb devstack@n-api.service[127033]: X-User-Name: tempest-TestShelveInstance-2022523655-project Oct 28 10:04:04.113442 dv-cinder-zed-3-smb devstack@n-api.service[127033]: method: > Oct 28 10:04:04.113442 dv-cinder-zed-3-smb devstack@n-api.service[127033]: exception: Instance d9b6a132-b028-452c-8b88-fc7b27ef8c0f could not be found. Oct 28 10:04:04.113442 dv-cinder-zed-3-smb devstack@n-api.service[127033]: action_args: {'id': 'd9b6a132-b028-452c-8b88-fc7b27ef8c0f'} Oct 28 10:04:04.114525 dv-cinder-zed-3-smb devstack@n-api.service[127033]: {{(pid=127033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:04:04.114525 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:04:04.114525 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:04:04.114525 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:04:04.114525 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:04:04.114525 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:04:04.114525 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:04:04.114525 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:04:04.114525 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:04:04.114525 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:04:04.114525 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9b6a132-b028-452c-8b88-fc7b27ef8c0f could not be found. Oct 28 10:04:04.114525 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 10:04:04.114525 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:04:04.114525 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 10:04:04.114525 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:04:04.114525 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:04:04.114525 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:04:04.114525 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:04:04.114525 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:04:04.114525 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:04:04.116248 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:04:04.116248 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:04:04.116248 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:04:04.116248 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:04:04.116248 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:04:04.116248 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:04:04.116248 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:04:04.116248 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9b6a132-b028-452c-8b88-fc7b27ef8c0f could not be found. Oct 28 10:04:04.116248 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 10:04:04.116248 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:04:04.116248 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 10:04:04.116248 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:04:04.116248 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:04:04.116248 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:04:04.116248 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:04:04.116248 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:04:04.116248 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9b6a132-b028-452c-8b88-fc7b27ef8c0f could not be found. Oct 28 10:04:04.116248 dv-cinder-zed-3-smb devstack@n-api.service[127033]: ERROR nova.api.openstack.wsgi Oct 28 10:04:04.117982 dv-cinder-zed-3-smb devstack@n-api.service[127033]: DEBUG nova.api.openstack.wsgi [None req-2a9b6d0f-a28d-4867-b689-88e2ba54b6a7 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Returning 404 to user: Instance d9b6a132-b028-452c-8b88-fc7b27ef8c0f could not be found. {{(pid=127033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:04:04.117982 dv-cinder-zed-3-smb devstack@n-api.service[127033]: INFO nova.api.openstack.requestlog [None req-2a9b6d0f-a28d-4867-b689-88e2ba54b6a7 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] 10.222.0.52 "GET /compute/v2.1/servers/d9b6a132-b028-452c-8b88-fc7b27ef8c0f" status: 404 len: 111 microversion: 2.1 time: 0.033267 Oct 28 10:04:04.117982 dv-cinder-zed-3-smb devstack@n-api.service[127033]: [pid: 127033|app: 0|req: 512/1043] 10.222.0.52 () {58 vars in 1236 bytes} [Fri Oct 28 10:04:04 2022] GET /compute/v2.1/servers/d9b6a132-b028-452c-8b88-fc7b27ef8c0f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:04:04.271844 dv-cinder-zed-3-smb devstack@n-api.service[127032]: DEBUG nova.api.openstack.wsgi [None req-9926c94c-ed77-41a7-ae0e-22c9a120bbc1 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] Calling method '.version_select at 0x7ff010116ee0>' {{(pid=127032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:04:04.300201 dv-cinder-zed-3-smb devstack@n-api.service[127032]: INFO nova.api.openstack.requestlog [None req-9926c94c-ed77-41a7-ae0e-22c9a120bbc1 tempest-TestShelveInstance-2022523655 tempest-TestShelveInstance-2022523655-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2097717922" status: 202 len: 0 microversion: 2.1 time: 0.032152 Oct 28 10:04:04.300795 dv-cinder-zed-3-smb devstack@n-api.service[127032]: [pid: 127032|app: 0|req: 532/1044] 10.222.0.52 () {58 vars in 1254 bytes} [Fri Oct 28 10:04:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2097717922 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)